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ABSTRACT 



This study was undertaken to relate Job Corps 
training outcomes to the costs of training, in terms of human talent, 
time, and material resources. Training outcomes or benefits were 
classified according to Job Corps objectives, then compared to total 
costs incurred by both training center and enrollee. Empirical 
validation and other evaluation of the procedure proved it to be 
sound and applicable in a comparison of manpower training programs. 
The results reversed several conclusions of earlier studies which had 
considered outcomes only. When costs are included in the analysis, it 
is no longer true that young or rural corpsmen perform poorly, when 
heavily oriented placement scales are used as criteria, the superior 
performance records of black corpsmen is reversed. A detailed 
presentation of the model is included, along with tables displaying 
the full results of the analysis. (BH) 
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PREFACE 



The Job Corps is a four year old experiment in approaches to training tie 
disadvantaged. Like a multitude of other federal, state, and local programs, it is an 
innovation in application, if not in concept. Data available to date has confirmed that 
Job Corps is operationally successful but questions of efficiency and transferability of 
results are continually raised. 

The present study was undertaken in an effort to determine the relationship 
between the input in the form of human talent, time, and material resources and the 
resulting training product. 

Recognizing the difficulties of benefits analysis for educational and training 
programs, new methodologies are applied to this investigation. The approach to cost 
benefit analysis used in this study avoids many of the pitfalls of other approaches. (See 
Introduction). No technique can be applied without good data sources; here Job Corps, 
with, its extensive information system, provided a great assist. 

Job Corps through this effort has taken a courageous step in extending the 
technology of program evaluation. Typically, innovations in methodology remain in the 
laboratory until their safeness is determined. 

This report is organized into two parts. Volume 1 is largely a narrative presenta- 
tion of the study procedures and its findings. Volume II is far more detailed and contains 
a presentation of the benefits model and its rationale as well as the data tables from 
which the conclusions presented in Volume 1 were drawn. This structure was chosen in 
order to enhance readability, yet present the findings accurately. 

Special acknowledgement should be given to Dr. Allen Bcnn who served both as a 
technical consultant and project leader. Dr. Bonn in cooperation with Gilmore Wheeler, 
former Chief of Evaluation and Research, was responsible for the development of the 
technique applied in this investigation. Further, the experience of Dr. William Darnell and 
Gilmore Wheeler with problems of evaluation in Job Corps contributed to the excellence 
of this study. Especially to the members of the Plans and Evaluation Division of Job 
Corps (particularly John Fischer and Mary Anne Hamtnerel) for their advice and 
patience, our thanks. 
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HIGHLIGHTS 



1. Several previously established "betterness” conclusions were reversed when 
costs per program termir.ee were considered. Examining only absolute effectiveness, older 
corpsmen have traditionally proven to do better in Job Corps than younger enrollees (16 
and 17 year olds). Similarly youth from large cities have, as a group stayed longer in the 
program and had better placement records. Cary Job Corps Center has proven to be one 
of the more effective Men’s Centers. These thice results in particular have been reversed 
or at least questioned under scrutiny of cost per terminee. 

The question underlying all three of these reversals is the relative benelit oi a long 
tenure in Job Corps. In each case, the reversal was a direct result of increased costs 
resulting from a long time spent in the program. 

2. Examining the age phenomenon as a function of type of center indicates that 
Conservation Centers (small rural men’s programs) prove to be more effective with young 
corpsmen than the larger urban Men’s Center programs. 

3. As might be expected, the large Men’s Centers prove most effective with 
corpsmen from large cities and metropolitan areas. Similar results are achieved for 
Women’s Centers (generally located in urban areas). Conservation Centers are most clfee- 
tive with rural youth. (All centers prove more cost effective with rural youth a function 
of length of stay and diminishing benefit?). 

4. Regional differences exist, but they appear to be a result of centers located in 
the region. Job Corps policy is to locate corpsmen in centers near home hence youth 
are typically enrolled in centers located within their home region. 

5. Cost benefit rankings were surprisingly constant across criterion scales. Typ- 
ically results achieved under the assumptions of one scale replicated when alternative 
scales were considered. 



6. A linear cost model proved sufficient for the analysis. Ari examination of set 
up costs, including travel, proved incidental. The cost of transporting a corpsman to and 
from a center and orienting him/her is very small when compared to the average cost of 
training. 

7. Interesting and confirming results were achieved when corpsmember race was 
considered. Negro corpsmembers generally performed better in terms of the effectiveness 
indicators considered. But, when cost effectiveness was examined, centers proved less 
cost beneficial with Negro youth, when a heavily placement oriented scale was considered, 
than with white youth. This indicates that even federal or regionally oriented programs 
have not solved the employment problem for Black terminees. This is confirmed when 
the results of the non placement oriented scale are examined. This latter scale indicates 
that within the program the Negro corpsmembers prove to be a cost-beneficial group. 

Each of the highlights treated above are examined in more detail in Section IV of 



this report. 



Section I 



INTRODUCTION 

The application of benefits analysis techniques, particularly cost benefits analysis, to 
the Job Corps framing program, is a natural extention of an already existing management 
system. The basic questions considered in this study are spelled out in the Job Corps 
program memorandum dated July 1968, and are further referenced in the legislative amend- 
ments for 1968. Other questions of focus in this investigation arc operationally important; 
they relate to increasing benefits for the corpsmembers by increasing program efficiency. 



Methodology: 



The strength of cost benefits analysis in making program decisions depends upon 
effectively handling the measurement o r program benefits. What benefit, value, or weight 
makes up the numerator of the cost benefit ratio? Most variations in the approach to 
cost benefits analysis are a direct result of the difficulties encountered in measuring 
benefits. The technique applied in this investigation was stimulated by the same set ol 
concerns. 

The technique can best be explained by a simple example. Suppose that Programs 
A and B are approaches to training. Assume further that both programs have essentially 
the same training objectives. The purpose of analysis is to determine whether or not 
Program A is more effective than Program B. What are the procedures that might be 
followed in making the comparison? The first step might be the definition of outcome 
categories for program terminees e.g., graduate, non-graduate, discharge. 

If these outcome categories are truly related to program objectives, and it is 
possible to establish valid values of benefit for each of these categories, then program 
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benefits can be calculated exactly, and the program comparison problem is solved. 
Consider the following: 

Membership in Category V has a benefit of 25 
Membership in Category IV has a benefit of 20 
Membership in Category 111 has a benefit of 15 
Membership in Category II has a benefit of 10 
Membership in Category I has a benefit of 0 



To compare Program A with Program B we m ultiply the percentage of terminees 
in each group by the known benefit, or weight assigned to the category. This results in a 
benefits score for the program. The program which has the greater score is determined to 
be most beneficial. Suppose the terminees from the programs were distributed across the 
five categories as follows: 



Program A: 



Program B: 



CATEGORY 



1 


II 


III 


IV 


V 


10% 


20% 


20% 


20% 


30% 



CATEGORY 



1 


II 


III 


IV 


V 


20% 


40% 


30% 


5% 


5% 



A decision might well be made to choose Program A, as it is the more effective program, 
based on the following: 



Effectiveness of Program A (. 1 0) 0 + (.20) 1 0 + (.20) 15 + (.20) 20 + (.20) 25 = 14 

Effectiveness of Program B (.20) 0 + (.40) 10 + (.30) (15) + (.05) 20 + (.05) 25 = 10.5 



Suppose it were also determined that the average cost per trainee in Program A was $200, 
and that the average cost per trainee in Program B was $|00. To examine the program 
effectiveness in light of costs, a simple benefit to cost ratio could be developed. 

The application of this ratio would reverse the "bettemess” conclusion reached 
above. Program A would have a benefit to cost ratio of 14/200 or .070 and Program B 
would have a benefit to cost ratio of 10.5/100 or .105 
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The example above is quite sterile. To bring meaning to the program comparison, 
two questions which control every cost benefits comparison need to be answered. The 
first question, “How were the categories defined?”, actually means, by what criteria do 
you assign a terminee to Category III versus Category IV? The second question may be 
more difficult to answer, “How do you determine the weights which are assigned to the 
categories.?” 

Whether the weights assigned to the categories arc based upon educational 
measures, such as reading gains; economic measures, such as anticipated life time earnings; 
or less rigorous measures, such as attitudes or good citizenship, the task of determining 
these values is extremely difficult and open to challenge. By refusing to accept the 
procedure used to determine weights the critic attacks the roots of the analysis. 

Assume that the objectives of the program are to increase earning power and 
develop good citizenship. If one is willing to assume that both earning power and good 
citizenship are directly related to reading achievement, then the weight assigned to the 
categories might be developed directly from an average reading gain, possibly using some 
form of economic conversion. To do this, historical data would have to be available. In 
addition, a method of conversion based on economic tables developed for other purposes 
would be needed. 

Alternatively, weights might be determined by a survey of the performance of 
corpsmen after leaving the program. This longitudinal study could develop weights to be 
assigned to each category. Once the weights were established, program effectiveness could 
be determined. 

Both of these approaches are lii lited either by narrowness in scope (everything 
reduced to reading gain) or by timeliness (three year follow up studies do not help with 
today’s decision). Further, every approach to handling social or citizenship benefits is faced 
with a problem of measurement. This measurement is necessary to determine valid numeri- 
cal weights for the categories. 

In general, the comparison of different programs suffers from the necessity of 
needing explicit knowledge of the weights, which correspond to each outcome category. 
Considering the categories defined above, what are the benefits to be attached to each? 



What about the assignment of 14 and 16 to categories 111 and IV respectively, or perhaps 
5 and 50? Economic analyses may suggest dollar weights equal to discounted life time 
earning gains, such as $5,000 and $10,000, Use of these benefits weights amounts to a 
conviction of their validity. 

Whether it be dollars, a simple linear scale, or some complicated formulation, the 
problem of determining appropriate benefit weights exists. Whichever scale is chosen, it is 
subject to attack with the simple argument that the weights should not be 14 and 16 nor 
5 and 50, but rather 7 and 9. The argument is simple minded and straight forward. But 
in fact who is to say? 

The present investigation represents the first attempt to apply a newly developed 
procedure* that goes through the same motions of scale development as described above, 
yet stops short of requiring numerical weights for the measures of benefit. 

This new technique assumes that, we cannot determine the benefits to be assigned 
to each outcome category, and instead assigns dummy numbers such as a, b, c, d and e 
to the five groups.** It then does a cost benefits comparison of Program A and Program B 
by placing conditions upon the dummy numbers until it is able to reach a decision. 

This process permits the decision maker to analyse the results of the analysis in 
light of the conditions required. The conditions are much more general than specific 
weights, since they concern benefit structures rather than the specific numbers. 

To illustrate the underlying principle of the new procedure, suppose there were 
just two program outcomes: success and lailure. failure yields exactly zero benelit; 
success yields an unknown amount of benefit, call it b. That is, the value attached to 
being a success is equal to b. Suppose, further, that Program A produces 70 % successes at 
$1000 each and Program B produces 60% successes at $500 each. This means that each 
participant entering Program A can expect or receive .7 x b benetils at an average cost ot 
$1000; while with Program B yields .6 x b benefits at $500. 



*The underlying mathematical theory is preented in Volume 11 of this report. 

**These dummy numbers represent points on a general benetils curve. For a more detailed discussion 
see the first part of the Results Section- Section 111. 
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The cost benefit index for Program A is .7 x b/ 1,000 = ,0007b and for Program 
B, .6 x b/500 = ,0012b. Although the precise values of these indices is indeterminant 
since b is unknown, a comparison is still possible. That is, since b has the same value in 
both indices, it can be ignored, and a comparison made by examining the numbers .0007 
and .0012. Since .0012 is greater than .0007, Program B is more cost effective than 
Program A-evei. though the value (weight) of being a “success” i.e., b, is unknown. 

Further, the amount by which Program B is better than Program A can be 
determined by dividing .0012 by .0007. In this example. Program B is more cost effective 
than Program A by almost 2 to 1. 

Unfortunately with more than two outcome possibilities the weights no longer 
cancel as directly as in the example. Far more advanced algebra is needed to affect 
similar conclusions. The procedure tests algebraically all possible sets of weights beginning 
first v/ith no restrictive assumptions on the nature of how the weights relate to one 
another (are they increasing? are they increasing with positive acceleration?, are they 
linear?). More and more assumptions are added until, finally, one program can be shown 
more cost beneficial than the other. At this time the procedure indicates l)what program 
is better and 2) the conditions that would have to be applied if the decision-maker chose 
to act on this information. The most stringent assumption ever required of the decision- 
maker is that the weights be some multiple of the outcome category number plus an 
arbitrary number. The arbitrary number may be 1 or 1 ,000,000, or any other. The 
decision-maker need not specify which. Therefore actual numerical values for weights 
need never be specified. 

A practical explanation of how one interprets the results of this new technique is 
given along with live data in the results section; the mathematical relationships which 
form the basis of the tables presented in that section are included in Volume 11. 

Outcome Categories: 

Job Corps has defined categories of output for its terminees, based on the level of 
program attainment and amount of time spent in the program. That is, did the corps- 
member complete a specified program of training, and if not, what were the conditions 
of termination? This is further modulated by the amount of time spent in pursuit of 
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these training goals. The time factor is included in an effort to credit the individual with 
some of the more subjective personal gains such as socialization and development of good 
personal habits. 



While issue might be taken with definition of these center-oriented outcome 
categories, they do exist and do have logical as well as empirical bases. What is important 
to this investigation if their existence. There is a second problem in any study of effective- 
ness: the identification of program objectives and related standards of attainment. We are 
not concerned here with value of membership in one of these categories, but rather Job 
Corps’ ability to reliably place a terminee in an outcome group. 

The primary outcome scale used in this study includes the eight groups defined 
below. It is these groupings that make up Scale I: 

1 . Stayed less than 30 days in Center but did not transfer. 

2. AWOLS with more than 30 days in Center. 

3. Disciplinary discharges with more than 30 days in Center. 

4. 31-90 days— voluntary resignations, transfers, medicals. 

5. 91-149 days- voluntary resignations, transfers, medicals. 

6. 150 days plus— voluntary resignations, transfers, medicals 

7. Graduates— job placement not verified. 

8. Graduates— job placement verified. 



Since the identification of outcome groups is so fundamental to the investigation, 
it was decided to include an alternative set of definitions which was based on program 
considerations and placement success. Since placement is an overall program objective 
which currently is not directly under the control of the Centers, it was decided to 
include it mainly for validation purposes and comparisons among regions. It is quite 
appropriate to regional center comparisons, however, since here rests full responsibility for 



both the program implementation and placement activity. These groups are defined as 
follows:* 

1. Category III unplaced 

2. Category II unplaced 

3. Category I unplaced 

4. Category III placed 

5. Category II placed 

6. Category I placed 

Outcome scales will be subject to change as more information is obtained and the 
Job Corps information system becomes more refined. An effort is presently underway in 
Job Corps to define more precise outcome categories based on specific skills attained. 

Summary: 

(1) Standards used in developing outcome categories are basically the same stand- 
ards that Job Corps has been using historically to evaluate programs. 

(2) The technique used in this investigation for combining the categories via out- 
come scales allows for standards measuring different aspects of program impact 
to be combined. 

(3) The technique does not require explicit representation of values of importance 
weights, or benefits attached to each outcome category. 

(4) The technique allows for analysis of the amount of benefit received for dollar 
spent of any program compared to another. 

(5) A secondary outcome scale was developed to validate results stemming from 
the primary outcome scale. 



*Category I, II, and III referenced here are predefined Job Corps Categories of termination. A category 1 
youth has completed a full training program and is certified by the Center Director. Categories 11 and 111 
have completed partial programs. Category II terminees have been in the program more than 90 days. 
Category III terminees have beenjn the program 90 days or less. 



Section II 
THE STUDY 



The discussion which follows summarizes the procedures involved in this investi- 
gation and the rationale behind decisions related to the analyses. For those requiring 
further clarification, a detailed explanation of how the model works is included in the 
first part of the Results Section. For those mathematically inclined, a mathematical 
treatment is provided in Volume II. 

Criterion: 

As noted in the introduction to this volume, the selection of outcome categories 
or criterion groups is essential to the analysis which follows. It is important that these 
categories represent the objectives of the Job Corps program, since they are the basis of the 
cost benefits comparisons. 

The categories selected for this investigation were logically constructed, with the 
assistance of Job Corps personnel, from definitions presently used by the Job Corps to 
describe terminees. Length of stay, reason for termination, program based categories, and 
job placement are presently considered as indicators of program success. The outcome 
categories developed for this investigation were derived from these same factors. (See 
discussion of Criterion in Section I.) 

Since the definition of these outcome groups is so important, it was decided to 
use not one scale for the analysis, but rather two scales, each oriented to a different 
philosophy of program objectives. Scale one is heavily affected by time in program and 
reason for termination. The second scale considers achievement categories and job 
placement. The scales are not completely different, but are sufficiently different as to 
provide sound validation of results. 

/ 
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Cost data used in this study was developed by the Job Corps finance division and 
provided to the contractor in a prespecified format. This data, like all other used in the 
main part of the investigation, was taken from existing Job Corps information sources. 
Cost of training refined by center or program group was used as the basic input to the 
cost benefits analyses. 

When comparing training success for population groups (e.g., age, size of home 
town, race, region), cost figures were, derived from training costs per man month and the 
number of months in training achieved by the group under consideration. That is, if the 
cost per man month for training is $300.00, and an individual remains in the program 6 
months, his cost factor is $1,800. Set up costs, transportation, screening, etc., were 
examined for possible separate treatment in order to remove bias. It was found that they 
made up a relatively small proportion of the total cost of training, and therefore, were 
included in the computation of an overall cost factor.* 

In summary, center costs are actual costs of operation obtained from the Job 

Corps data system. These include enrollee expenses as well as operating costs. For 

comparisons among population groups, derived cost figures, based on length of stay, and 
predetermined center costs were used. 

Cost/Benefit Comparisons: 

Several sets of cost benefit comparisons were made for each type of Job Corps 

center. These comparisons included center by center rankings, sponsor type, placing 

agent, home region of the enrollee, and center size. Limitations in the data** precluded a 
planned examination of screener type. 

In addition to asking these basic questions, the complete Job Corps information 
system, which includes over 70 factors, was examined. This was done in an attempt to 
determine if individual characteristics of corpsmembers might be important as far as cost 
benefits is concerned. To do this a multivariate analysis procedure, which indicates the 

To test this assumption alternative models were considered. See discussion under ‘Tndepth 
Treatment of Men’s Centers”, in Results section of this report. 

**Change in coding structure in the JCIS and Scrcencrs Handbook. 



relationship between success as defined by the outcome scale and the individual char- 
acteristics, was used. Figures 3.1, 3.2, and 3.3 present the basic comparisons included in 
the investigation. 

Factors such as age, race and size of home town, proved important. These factors 
considered often before in other contexts were examined here in light of cost benefits. 
From the cost benefit point of view the results are both interesting and informative. 
Strict analysis of these variables was combined with a second inquiry into the main 
program variables. The question was asked whether or not the results of the program 
comparisons would be different for different groups of corpsmembers. That is, “Do 
center types or centers prove more or less cost beneficial depending upon the type )f 
corpsmember served, or, alternatively, will differential assignment of corpsmembers make 
the overall program more cost beneficial for all corpsmembers?”. This latter question is 
only touched upon in this investigation, but proves to have great impact, on program 
design and enrollee assignment procedures. 

Finally* program effectiveness, exclusive of cost, was examined in those cases 
where cost benefit comparisons raised important issues. One case in point is corpsmember 
age. Frotn the cost benefit point of view, young corpsmembers prove to be more cost 
beneficial. When one examines benefits alone, irrespective of cost, the conclusion is 
reversed. At issue here, is a philosophical point which is discussed further in the 
conclusions section: “Should program evaluation be center oriented or individually 
oriented?” This issue has important implications for the analysis of program results. 

Information Sources: 

The primary source of data used in this analysis was the Job Corps Information 
System (JCIS). This large system contains detailed information on corpsmembers including 
historical and demographic data, program accomplishments, event data (entry, termination, 
etc.), and placement information. Cost data as noted earlier was obtained from Job Corps 
finance records. In order to provided current results, records for corpsmembers who termi- 
nated prior to fiscal year 1968 were not included. Additionally, incomplete records, those 
which did not include the basic information needed for this analysis, were excluded. The 
procedure resulted in a final sample of approximately 40,000 individual records of enrollees 
terminating during this tim<j period. 
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FIGURE 3.1 

Matrix of Basic Comparisons Made for Conservation Centers 
in This Investigation 
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The above figure illustrates the various analyses undertaken during this study. These analyses are 
summarized in the Results Section of this Volume. All comparision tables are included for examination 
in Volume II. Three additional scales were examined late in the investigation. They are not included in 
this report. 
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FIGURE 3.2 



Matrix of Basic Comparisons Made for Womens Centers 
in This Investigation 
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The above figure Illustrates the various analyses undertaken during this study. These analyses are 
summarized in the Results Section of this Volume. All comparision tables are included for examination 
in Volume II. Three additional scales were examined late in the investigation. They are not included in 
this report. 
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FIGURE 3.3 

Matrix of Basic Comparisons Maria for Mans Canters 
in This Investigation 
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The above figure illustrates the various analyses undertaken during this study. These analyses are 
summarized in the Results Section of this Volume. All comparision tables are included for examination 
in Volume II. Three additional scales were examined late in the investigation. They are not included in 
this report. 
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Section ill 
HIGHLIGHTS 

1 . Several previously established “betterness” conclusions were reversed when 
costs per program terminee were considered. Examining only absolute effectiveness, older 
corpsmen have traditionally proven to do better in Job Corps than younger enrollees (16 
and 17 year olds). Similarly youth from large cities Save as a group stayed longer in the 
program and had better placement records. Gary Job Corps Center has proven to be one 
of the more effective Men’s Centers. These three results in particular have been reversed 
or at least questioned under scrutiny of cost per terminee. 

The question underlying all three of these reversals is the relative benefit of a long 
tenure in Job Corps. In each case, the reversal was a direct result of increased costs 
resulting from a long time spent in the program. 

2. Examining the age phenomenon as a function of type of center indicates that 
Conservation Centers (small rural men’s programs) prove to be more effective with young 
corpsmen than the larger urban Men’s Center programs. 

3. As might be expected, the large Men’s Centers prove most effective with 
corpsmen from large cities and metropolitan areas. Similar results are achieved for 
Women’s Centers (generally located in urban areas). Conservation Centers are most effec- 
tive with rural youth. (All centers prove more cost effective with rural youth-a function 
of length of stay and diminishing benefit?). 

4. Regional differences exist, but they appear to be a result of centers located in 
the region. Job Corps policy is to locate corpsmen in centers near home hence youth 
are typically enrolled in centers located within their home region. 

5. Cost benefit rankings were surprisingly constant across criterion scales. Typ- 
ically results achieved under the assumptions of one scale replicated when alternative 
scales were considered. 
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6. A linear cost model proved sufficient for the analysis. An examination of set 
up costs, including travel, proved incidental. The cost of transporting a corpsman to and 
from a center and orienting him/her is very small when compared to the average cost of 
training. 

7. Interesting and confirming results were achieved when corpsmember race was 
considered. Negro corpsmembers generally performed better in terms of the effectiveness 
indicators considered, but, when cost effectiveness was examined, centers proved less 
cost beneficial with Negro youth, when a heavily placement oriented scale was considered, 
than with white youth. This indicates that even federal or regionally oriented programs 
have not solved the employment problem for Black tcrminees. This is confirmed when 
the results of the non-placement oriented scale are examined. This latter scale indicates 
that within the program the Negro corpsmembers prove to be a cost-beneficial group. 

Each of the highlights treated above are examined in more detail in Section IV of 
this report. 
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Section IV 



RESULTS 

Since the results of this investigation are issue oriented, section one of this part of 
the report will focus in depth on one example situation. The nature of the scales used, 
the cost model, and cost effectiveness vs. strictly effectiveness analyses will be examined. 
Six men’s urban centers have been selected for this examination since they provide the 
most stable data base due to their size. Further, definite positions as to their relative 
worth have evolved within Job Corps based upon patterns of success in training 
corpsrnen as measured by existing objective and subjective evaluation procedures. 

The six programs examined here are Atterbury, Breckinridge, Clearfield, Gary, 
Kilmer, and Parks. Each is a large men’s center providing skill training to disadvantaged 
youth. Although each program differs in specific skill training offered, the population of 
youth each serves is effectively the same, and the overall program objectives have been 
considered by the Job Corps to be equivalent. 

The data sources used in this investigation are the Job Corps Information System 
and official cost records. The population of terminees treated are those corpsrnen who 
completed programs or otherwise left their centers during fiscal year 1968 and the first 
half of fiscal year 1969. A check of critical statistics, such as placement percentages, 
indicates that the data used for the study is valid; where deviations have occurred, the 
possible bias proved to have no effect on the overall results. 

The discussion which follows immediately is the most important part of this 
document. It must be kept in mind when examining the more extensive presentation of 
data in Volume II. Interpretation of results is always difficult, but in this case is even 
more delicate since we are considering a new philosophy approach to program analysis. 

For the main portion of this investigation two scales are used to compare program 
success. Each is constructed differently in order to provide as full a validation of the 



results as possible. Scale 1 categorizes program terminees into eight groups (see Page 6). 
These categories are based upon reasons given for termination and the amount of time a 
corpsman stayed in the program. Scale II (see Page 7) is based upon job placement and 
designated programs success categories. The latter scale is intended to be largely time 
independent. 

The costs used for computing cost benefits rankings are a product of costs per 
term i nee, a function of operating costs per man-month and the man-months of training 
provided a corpsman. 

An analysis of the six men’s centers using the cost benefits model produces the 
ranking of the programs which is included in Table 4.1. 



TABLE 4.1 

Relative Cost Benefits Rankings for Men’s Center Programs 
Using Scale I. Standard Cost Model 



Overall 

Rankings 


Program by Program 


Comparison 




RANK 


PROGRAM 


KILMER CLEARFIELD 


ATTERBURY 


GARY 


PARKS 


1 


Breckinridge 


3,11 2, IV 




i,i 


1,1 


1,1 


2 


Kilmer 


2 , IV 




i,i 


1,1 


1,1 


3. 


Clearf ie Id 






4,11 


1,1 


1,1 


4 


Atterbury 








4,11 


1,1 


5 


Gary 










1,1 


6 


Parks 













In the above table the arabic numbers represent levels 



of assumption under convex conditions. Roman numbers represent 
assumptions under concave conditions. The cell entry is the 
level at which the program in column one is determined to be 
more cost beneficial than the program heading the other 
columns . 



Column one in Table I represents the relative rank of the six programs. The 
numbers (arabic and roman) in the other columns of the table represent the level of 
assumpition which must be made for any given center to outrank another. The arabic 
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number pertains to convex assumptions concerning the benefits curve. The roman number 
represents concave assumptions. A further explanation of these assumptions follows. 



Exhibit 4.1 

Examples of Convex 
and 

Concave Benefits Curves 




Category 
Convex curvos 




An interpretation of the table shows Breckinridge to be the most cost beneficial 
men’s center and Parks, the least cost beneficial. In between, the other centers rank as 
indicated on the left: Kilmer is second; Clearfield is third; and so on. This ranking is 
based on Scale 1 and the standard cost model. 

Reading the rest of the table is a little more difficult due to the concepts 
involved. But it is the numbers which contain most of the important information 
concerning the rankings. The discussion of the model in Section II of this report gives 
considerable attention to the nature of the benefits curve. That is, if one were going to 
assign values to the outcome categories described by the scale, how should the values be 
assigned? The numbers in the table tell the reader how the values would have to be 
assigned if the cost benefit ranking is going to be accepted. 

The meaning of the numbers, in light of the Table 4.1 discussion, is summarized 

below. 

A. The number zero is the most powerful tase. It is seldom seen, but if seen, it 
means that it is not possible to reach any other decision concerning the 
ranking, no matter what set of values are chosen for the categories. They can 
be scored best to worst; worst to best; high in the middle, low at either 
end- anything goes. 

f 
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B. The number one, arabic or roman, in practical applications, is almost as 
powerful as zero. It requires only that the benefits curves, values assigned to 
the categories, are ordinal. That is, being a member of category eight is more 
valuable (beneficial) than being a member of category seven by some amount, 
small or large; and similarly, category seven has more value associated with it 
than category six; six beats five; and so on. (Note: it is all right for one or 
two groups to have the same value, so long as the values arc not decreasing 
ones.) 

C. The number two is slightly more restrictive than one. In the case of the 
number one, the shape of the benefits curve is completely irrelevant. The 
values simply increase from lowest to highest across categories. That the curve 
is convex (opening upward) or concave (opening downward) does not matter. 

Specifically, level two assumptions require the user to determine 
whether most of the corpsmembcrs’ benefits are greatest in the first few 
categories or in the upper categories. When are benefits gained from the 
program. For Scale I, which is heavily alfected by length of stay, the question 
reduces to whether or not a corpsman benefits most from his early days in the 
program or from his later days in skill training. 

Level tliree is only slightly more restrictive than level two. It simply says that 
the shape of the curve is important as in level two, but in addition there must 
be some perceptible gain for every category. Level two permits one or two 
categories to have the same value - an almost meaningless restriction in the 
case of a complex training program like Job Corps. 

Level IV is the most restrictive case considered by the model. To accept a 
cost benefits ranking at this level means that the reader must assume that the 
benefits curve is linear (represented by a straight line which passes through 
the origin.) The latter simply means that the first outcome corresponds 
to a failure condition with no associated benefit. Such a set of values for 8 
categories might be: 

(0, I, 2, 3, 4, 5, 6, 7) 

or 

(0, 10, 20, 30, 40, 50, 60, 70) 

or 

(0, 153, 306, 459, 612, 765, 918, 1071) 
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Returning to the results in Table 4.1 : 



TABLE 4.1 

Relative Cost Benefits Rankings for Men’s Center Programs 
Using Scale I. -Standard Cost Model 



Overall " 

Rankings Prog ram by Pro gram C omp arison 



RANK 


PROGRAM 


KILMER CLEARFIELD ATTERBURY 


GARY 


PARKS 


1 


Breckinridge 


3,11 2 , IV 1,1 


1,1 


1,1 


2 


Ki lmer 


2 , IV 1,1 


1,1 


1,1 


3. 


Clearfield 


4 , II 


1,1 


1,1 


4 


Atterbury 




4,11 


•1,1 


5 


Gary 






1,1 


6 


Parks 










Column one represents 


the overall ranking of programs. The arabic 


and roman 



numbers represent the level of assumption necessary to accept a given comparison 
between programs. As the numbers increase, the power of the comparison decreases. It is 
not possible, however, for the rankings to be reversed. Rather, the user may choose not 
to accept the assumptions necessary and assume no relative program difference. 

Consider: 

Breckinridge is determined more cost beneficial than Atterbury. Gary and Parks at 
level one. This means that no matter what set of ordinal values the user chooses to assign 
to the outcome categories, Breckinridge remains the most cost beneficial. It does not 
matter whether one argues that most of the benefits are obtained early in the program or 
conversely, if one argues that the greatest value is attained late in the program. This is an 
exceptionally strong position. 

Breckinridge is determined more cost beneficial titan Kilmer at level three under 
convex assumptions and at level two under concave assumptions. The fact that the model 
requires this level of assumption indicates a greater degree of closeness than in the case of 
the above described three centers (Kilmer is also more cost beneficial than Atterbury, 
Gary, and Parks at level one.) Yet. Breckinridge remains significantly in position since the 




model requires only that the values continue to increase if the convex case (greater worth 
later) is accepted, and that if the concave case is accepted, the increase to be regular and 
steady, with no two categories having the same value. Any of a very large set of benefits 
curves will satisfy these assumptions. 

For example: 

In the convex case, Breckinridge would beat Kilmer cost benefits wise if the 
values assigned to the eight categories were either: 

(0, 1, 2, 3, 4, 5, 6, 7) 
or 

(0, 1, 4, 9, 16, 25, 36, 49) 
or 

(0, 2, 6, 12, 20, 30, 42, 56) 

In the concave case, either of the following sets of values would satisfy the 
conditions: 



(0, 10, 15, 15, 16, 17, 18, 19, 10) 
or 

(0, 1000, 1500, 2000, 2100, 2102, 2103, 2103) 



O 
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In four cases a linear assumption is necessary for program by program compar- 
isons to be made. It will be seen later (during discussion of cost models) that even this 
most restrictive case is a relatively strong position, and that comparisons which require 
level four may still be quite significant. 

In summary, Table 4.1 indicates that Breckinridge is the most cost beneficial 
program of the six examined and further, that Breckinridge and Kilmer emphatically beat 
Atterbury, Gary, and Parks in the rankings. Further, as might be expected, it typically 
requires a higher level assumption for a program to be determined more cost beneficial 
than the next in line, than it does for those further down the rankings. Parks proves least 
beneficial and, significantly, is bested by all programs at level one on this scale. 
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Men’s Centers, Scale II: 



Scale I is heavily influenced by length of stay, and it might be argued that the 
strong correlation between length of stay and cost of training leads to spurious cost 
benefit rankings. In order to examine this situation, a second scale derived from a 
placement orientation (e.g. job placement is an extremely important criterion) has been 
devised. This six-category scale is a function of placement and program-based category of 
termination (see Page 7). 



TABLE 4.2 



Relative Cost Benefits Rankings for Men’s Center Programs 
Using Scale II.— Standard Cost Model 


Overall 

Rankings 


Program by Program Comparisons 




RANK 


PROGRAM 


KILMER CLEARFIELD 


ATTERBURY 


GARY 


PARKS 


1 


Breckinridge 


3,11 1,1 


1,1 


3,11 


0,0 


2 


Kilmer 


2, IV 


2,11 


3,11 


1,1 


3 


Clearfield 




3,11 


4,11 


0,0 


4 


Atterbury 






4,11 


1,1 


5 


Gary 








1,1 


6 


Parks 











In the table above, the arabic number indicates the 
level at which the center in the left hand column is more 
cost beneficial than the center heading the column under 



convex assumptions. The roman number refers to the concave 
case . 



An examination of Table 4.2 indicates that the overall center rankings have not 
changed from Scale I to Scale II. Breckinridge continues to prove most cost beneficial 
while Parks makes another poor showing. Based upon this scale, Park’s position is 
significantly weakened with two programs being identified as more beneficial at the 
seldom seen level zero. Gary, while remaining fifth in the overall rankings, forces, forces 
the assumptions to a higher level in all comparisons. An examination of the basic data 
indicates that th.s low ranking is due to Gray’s very large percentage of Category I 



corpsmen who are placed in jobs. (This group of corpsmen comprises category six on 
Scale II.) In spite of this large group and the fact that the decision level is forced upward 
in restrictions, Gary remains fifth in the rankings due to an excessively high unit cost 
per terminee. 

In summary, the center rankings are unchanged from Scale I to Scale II although the 
assumptions required to accept the cost benefits decision increase. This is not particularly 
disconcerting since the following benefits assigned to the six categories would satisfy the 
Breckinridge-Gary comparison in the convex case: 

( 0 , 2 , 6 , 12 , 20 , 30 . 42 ) 
or 

( 0 , 10 , 220 , 630 , 1240 , 2050 , 3060 ) 



or in the concave case: 

( 0 , 10 , 15 , 16 , 17 , 18 ) 
or 

( 0 , 1000 , 1500 , 2000 . 2001 , 2002 ) 

The strength of the model and the confidence one can have in a decision made 
even at the higher levels of assumption can be seen when i ecting the variety of 
acceptable sets of benefits values. 

If either of the scales, derived from usual criteria, have any validity, the results 
are startling. The rankings provided by the cost benefits model are different from what 
one might have expected. Gary has been singled out often as a low cost, high benefit 
program. In the discussion that follows, Gary will prove again to be a high benefit 
program. It incurs problems when low man year costs are converted into costs per 
terminee. 

Men’s Center Effectiveness: 

The results just reported caused some initial concern. How is it possible that Gary 
ranks number five and Clearfield ranks number three on both scales'? In order to validate 



both the technique and the data base used in the study, costs per terminee are set as 
equal across all programs and benefits only are considered for both Scale I and Scale II. 

The results of this analysis are presented in Table 4.3 which follows. 



TABLE 4.3 

Effectiveness Rankings for Men’s Center Programs 
on Both Scales I and II; 

Costs Set Equal Compared With Previously Derived Ranking 
Developed by Job Corps 



RANK 


Overall Ranking 
Scale I 


Overall Ranking 
Scale II 


Earlier Job Corps* 
Ranking 


1 


Breckinridge 


Gary 


Gary 


2 


Gary 


Breckinridge 


Breckinridge 


3 


Kilmer 


Atterbury 


Atterbury 


4 


Atterbury 


Kilmer 


Parks 


5 


Parks 


Parks 


Clearfield 


6 


Clearfield 


Clearfield 


Kilmer 




♦excluding the 


cost variable it is 
2/69 by J/P/P 


as developed 



The effectiveness rankings remain quite stable across Scales I and II, and except 
for the slip to position six on the earlier Job Corps ranking, remain quite stable across 
the three scales. The Kilmer slip is explained by the fact that the rankings in this 
investigation are based upon terminations in fiscal year 1968 and 1969 and the earlier 
ranking is based on fiscal year 1969 only, indicating a dramatic recent decrease in center 
performance. Further, the earlier ranking is a weighted sum of rankings* based on average 
length of stay, ’’ropout rate, and placement percentage and educational gains; hence 
somewhat different. (In that ranking, educational gains were effectively constant across 
centers.) 

More detailed examination of the data underlying the effectiveness rankings 
further confirmed the validity of the source data. 



•This procedure tends to exaggerate small differences in absolute value on each scale. 



A reexamination of Tables 4.1 and 4.2 in light of Table 4.3 shows the impact of 
this approach to program analysis. The success of a center like Gary becomes less 
inspiring when placed under the microscope of training costs per individual. Similarly, a 
center with a less exciting record like Clearfield looks significantly better when individual 
training costs are considered. Other programs such as Breckinridge stand up well under 
either type of examination. 

The Cost Model: 

It might be argued that the cost model used in this study is inappropriate. Since 
it is linear, it does not penalize sufficiently the center with a high turnover rate, which 
would reflect high setup costs, including testing, orientation, travel, screening, etc. It should 
be noted that it also fails to single out high cost training, travel, and allotments for 
terminees who remain in the program longer periods of time. 

Granting the earlier arguments for the moment, let us consider several alternative 
models which emphasize front end loads (e.g., setup costs). 

Table 4.4. compares three such models for criterion Scale I. They include the 
standard model (Table 4.1), a $300.00 setup cost per enrollee and a $1,000.00 setup 
cost. The stability of the results confirms the earlier findings. 

TABLE: 4.4 

Relative Cost Benefits Comparisons for Men’s Centers 

on Scale I, 

Examined Under Three Cost Models 



RANK 


Overall Ranking 
Standard Model 


Overall Ranking 
$ 300 Setup Costs 


Overall Ranking 
$ 1,000 Setup Costs 


1 


Breckinridge 


Breckinridge 


Breckinridge 


2 


Kilmer 


Kilmer 


Kilmer 


3 


Clearf ie Id 


Clearfield 


Clearfield 


4 


Atterbury 


Atterbury 


Gary 


5 


Gary 


Gary 


Atterbury 


6 


Parks 


Parks 


Parks 



Witli setup costs as high as $1,000 per enrollee, Gary moves up the scale only one 
level. All other programs hold the same relative positions attesting to the stability of the 
rankings. It might be worth a moment to note that even level four decisions cited in 
Table 4.1 remain unaffected with a $300 load factor. Identical results were achieved with 
Scale H. 

Hence, neither the scale nor the cost model affects this particular ranking 
significantly and one can certainly state with confidence that Breckinridge is the most 
cost beneficial center and Parks is the least cost beneficial. The results of other compar- 
isons will not be treated in the same detail in Volume 1. All the necessary data to do so, 
however, is available in Volume II or in supporting documents submitted with this report. 

An Interesting Sidelight: 

Before proceeding with a discussion of the remainder of the findings it might b: 
worth considering another side investigation related to men’s centers in general and to 
Gary in particular. Gary has a very low man-year cost and a very high effectiveness 
ranking, yet it shows up poorly under cost benefit rankings. The most obvious reason is 
the long average length of stay and therefore high individual cost. Assuming that all other 
centers were held constant, what is the optimum length of stay for Gary (e.g. what 
average length of stay would move the program back to the top of the rankings on Scale 
II)? 

An examination of this question indicates that Gary would have to have a 180 
day average length of stay while not increasing operating costs and further maintaining its 
performance level to achieve first place on Scale 11. This is a tall order calling lor a 
change in operating philosophy. 

Is it possible that the bases for evaluation represented by these scales are 
inappropriate, Is a Category I terminee or graduate as presently defined by Job Corps ioo 
ambiguous a term, thereby penalizing Gary? The question of criterion scales is raised 
again in Section VI of this volume. 

Other Results: 

The balance of the investigation will be treated in summary form in this section. 
The complete investigation includes the production of over 200 different comparisons. 



All of these documents have been provided to Job Corps with this report. The majority 
of the data is also summarized in tabular form in Volume II. What follows is a narrative 
presentation of the findings presented, without further reference to concerns that might 
exist over choice of criterion scales. 

The model and the data base have been adequately supported and should no 
longer remain at issue. The cost model has similarly withstood scrutiny. 

Populations Considerations: 

Several key population variables are examined in the course of this investigation 
in order to determine if differential effects do in fact exist. Is it possible that particular 
programs are more cost beneficial for one given subpopulation than for another? In 
addition, questions of strict effectiveness (without regard to cost) are treated for selected 
comparisons. A summary of these results follows. More detailed data is presented in 
Volume II. 

Home Region: 

The population of Job Corpsmen terminating in fiscal year 1968 and fiscal year 
1969 is sub-divided by regions and is treated as separate program groups for the purpose 
of this analysis. Hacli of these regional subgroups is compared within center type on both 
Scale I and Scale II. Table 4.5 below summarizes the overall rankings for the regions for 
each of the six comparisons. 

The relative success in training (cost benefits wise) of youth from a given regions 
remains fairly eonstant from Scale 1 to Scale II within center type indicating, as might be 
expected from the earlier discussion of Men’s Center programs, that the cost benefits 
rankings remain stable. The differences across center type, however, prove very inter- 
esting. 

Differences in regional rankings across center type are substantial. Is it possible 
that Men’s Centers are most cost beneficial working with youth from region 6 while 
Women’s Centers do very poorly with girls from the same region? Similar differences exist 
for the other regions considered. It is quite likely that these apparent regional differences 
are a function of the centers in the region in question since it is Job Corps’ policy to 
place youth in centers near their home whenever possible. 
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TABLE 4.5 



Cost Benefits Rankings for the Severn Job Corps Regions 
Within Center Type for Both 
Seale l and Seale II 



RANK 


MEN' 
Scale I 


S 


CENTERS 
Scale II 




WOMEN ' 
Scale I 


S 


CENTERS 
Scale II 




CONSERVATION 

CENTERS 

Scale I Scale II 




1 


Region 


6 


Region 


6 


Region 


1 


Region 


1 


Region 


7 


Region 


7 


2 


Reg ion 


2 


Region 


3 


Region 


3 


Region 


3 


Region 


4 


Region 


4 


3 


Region 


3 


Region 


2 


Region 


7 


Region 


5 


Region 


6 


Region 


6 


4 


Region 


7 


Region 


4 


Region 


5 


Region 


2 


Reg ion 


5 


Region 


5 


5 


Region 


4 


Region 


7 


Region 


2 


Region 


7 


Region 


2 


Region 


2 


6 


Region 


1 


Region 


5 


Region 


4 


Region 


6 


Region 


3 


Region 


3 


1 


Region 


5 


Region 


1 


Region 


6 


Regi.on 


4 


Region 


1 


Region 


1 



In summary, differential effects across center type are quite significant. These 
effects, however, might be the direct result of the performance of centers located in the 

i 

regions in question. S 

Racial Effects: 

A second population characteristic examined is the corpsmember’s race. I his 
particular factor has provided mixed results. 

If one considers effectiveness only (costs held fixed), all centers are uniformly 
more successful in their efforts with Negro corpsmembcrs than with white youth. This is 
true for both Scale I and Scale II, and therefore supports earlier conclusions. 

When effectiveness is examined in light of cost considerations, the results are less 
uniform. For each center type Men’s, Women’s, and Conservation it has been determined 
that the programs remain most cost beneficial lor Negro youth as measured by Scale I. 
When Scale II is examined, the results are reversed. The extra costs incurred by a longer 
average length of stay are too great and overcome the increase in measured effectiveness. 
(Recall the Gary example where effectiveness rankings are similarly reversed by cost 
considerations.) 




, < , t 



Tlic scales apparently arc measuring different things, sufficiently different to result 
in this interesting reversal. Apparently the significant success in holding Negro youth in 
programs (Scale I) is diminished when the problem of job placement is encountered after 
leaving the center (Scale II). 

Size of Home Town: 

In addition to race and region of the country from which a corpsinan originates, 
size of home town has L>een examined. The results of this analysis are quite mixed both 
when effectiveness only (Tabic 4.6) and when cost effectiveness (Table 4.7) are con- 
sidered. Preliminary interpretation indicates that size of home town might be a factor 
worth considering when making assignments to program. Further examination is, of 
course, required. 

TABLE 4.6 

Effectiveness Rankings for Size 
of Home Town by (Tenter Type 
Costs Set Equal 



RANK 


MEN'S 
Scale I 


CENTERS 
Scale II 


WOMEN ' S 
Scale I 


CENTERS 
Scale II 


CONSERVATION CENTERS 
Scale I Scale II 


1 


50,000- 
250, 000 


50,000- 
250 , 000 


50 , 000- 
250,000 


over 

250,000 


2 , 500- 
50 , 000 


2,500- 

50,000 


2 


over 

250,000 


2,500- 

50,000 


over 

250,000 


50,000- 

250,000 


under 
2 ,500 


50,000 

250,000 


3 


2,500- 

50,000 


over 
250 , 000 


under 

2,500 


2 , 500- 
50 , 000 


50,000- 

250,000 


under 
2 ,500 


4 


under 

2,500 


under 

2,500 


2 , 500 
50,000 


under 

2,500 


over 
250 , 000 


over 

250,000 



Inspection of the above table presents the reader with an interpretive dilemma. The 
: effectiveness rankings for si/e of home town change both within and across center types. 

However, for both Men’s Centers and Women’s Centers there is a tendency to 
separate on a small vs. large continuum. Both these urbanized skill programs tend to do 
better with youth from large cities and more 'poorly with youth from rural areas. 
Conservation Centers on the other hand do well with rural youth on Scale I. reflecting 
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their holding power with rural youth. On Scale 11, success with rural youth decreases 
significantly. This decrease reflects placement problems, due probably to a tendency for 
these corpsmen to return to low-employment rural areas. Significantly, the eflectiveness 
of Conservation Centers is poorest for youth from n etropolitan areas on both criterion 
scales. Hence, we see a correlation between the location of the center (rural urban) und 
the home town of the corpsman (rural-urban). 



TABLE 4.7 

Relative Cost Benefit Rankings 
for Size of Home Town by Center Type 
Standard Cost Model 



RANK 


MEN'S CENTERS 
Scale I Scale II 


WOMEN ’ S 
Scale I 


CENTERS 
Scale II 


CONSERVATION CENTERS 
Scale I Scale II 


1 


under 


under 


under 


under 


under 


50,000- 




2,500 


2,500 


2,500 


2,500 


2,500 


250,000 


2 


2,500- 


2,500- 


2,500- 


2,500- 


over 


under 




50,000 


50,000 


50,000 


50,000 


250,000 


2,500 


3 


50,000- 


50,000- 


50,000- 


over 


50,000- 


2,500- 




250,000 


250,000 


250,000 


50,000 


250,000 


50,000 


4 


over 


over 


over 


50 , 000- 


2,500-- 


over 




250,000 


250,000 


250,000 


250 , 000 


50,000 


250,000 



The above table shows strikingly similar results for Men’s Centers and Women’s 
Centers, indicating that the size of home town is important although it is not clear what 
the effect is specifically. The under 2,500 group, rural youth, prove most cost beneficial. 
These corpsmembers stay in the centers less time (Scale I effectiveness -Table 4.0) and 
hence have lower training costs. Even though Table 4.6 shows rural youth to be benefited 
least, the increase in benefits received by the other groups does not appear to justify the 
increased cost resulting from a longer time in program. 

An earlier note should be re-emphasized here again. The comparisons made in this 
study are only as good as the criterion scales used. These criterion scales, while the best 
available, may be inappropriate measures of Job Corps objeetives. 



In general, it may be said in summary that while typical youth from large cities 
do better as a group than youth from rural areas, the increased benefits attained may not 
offset the increased cost resulting from long residency. The issue is one of diminishing 
returns and raises the question concerning the relative value (cost benefits wise) of 
two-year training programs. It seems that from an overall benefits point of view, a shorter 
period— say one year— might prove most economical and still achieve reasonable results. 
(The earlier case of Breckinridge might be worth closer examination in order to establish 
guidelines.) 

Race and Size of Home Town: 

The interaction of race and size of home town was thought to have possible 
consequences for program decisions. Like all interactions the results are very difficult to 
interpret, particularly when one factor is as complicated as size of home town has proved 
to be. 

In the earlier discussion of racial comparisons, the programs prove most cost 
beneficial for Negro youth when Scale I is used as a criterion. For Scale II the programs 
prove most cost beneficial for white corpsmen. When size of home town is considered, 
the programs are generally most cost beneficial for rural youth. 

The interaction of the two factors has provided some interesting results. For 
Conservation Centers the most cost beneficial groups are directly related to earlier 
findings. For Scale I. the programs prove most cost beneficial for rural Negroes. For Scale 
II, the program is most cost beneficial for white youth from middle sized cities. On Scale 
I the racial factor is clearly overpowering, with Negro youth sweeping the four top 
rankings for all four home town groupings. This is not true for Scale II where the results 
are mixed. 

For Men’s Centers the results are similarly predictable indicating that at least for this 
interaction of corpsman characteristics, the results are essentially additive with no surprises. 
For Women’s Centers the results are less predictable but similarly not surprising. 

Age Effects: 

Job Corps has dealt extensively with the poblem of young corpsmen. It has been 
demonstrated that the younger a corpsman the less successful Job Corps is. Sixteen and 



seventeen year olds have proved particularly difficult in general since they are often 
unemployable because of age restrictions after having completed their programs. 

Table 4.8 reexamines this issue and again confirms earlier findings. When effective- 
ness only, and not training costs, is considered, sixteen and seventeen year olds rank lowest. 



TABLE 4.8 

Effectiveness Rankings for Age Groupings Within Center Types 
On Both Scale 1 and Scale II 



RANK 


MEN'S 
Scale I 


CENTERS 
Scale II 


WOMEN ' 
Scale I 


S CENTERS 
Scale II 


CONSERVATION CENTERS 
Scale I Scale II 


1 


19 


19 


20 


20 


21 




18 


2 


20 


21 


19 


19 


19 




20 


3 


21 


20 


21 


21 


20 




IS 


4 


18 


18 


18 


18 


18 




21 


5 


17 


17 


17 


17 


17 




17 


6 


16 


16 


16 


16 


16 




16 




The plaguing question 


of diminishing 


returns reoccurs 


when the 


age 


question is 



examined from a cost benefits point of view. Table 4.9 presents the results of the cost 
benefit comparisons for age within center types. 



TABLE 4.9 

Relative Cost Benefit Rankings for Age Groupings Within Center Types 

Standard Cost Model 



RANK 


MEN'S 
Scale I 


CENTERS 
Scale II 


WOMEN ' S 
Scale I 


CENTERS 
Scale II 


CONSERVATION CENTERS 
Scale I Scale II 


1 


19 


17 


16 


16 


16 


16 


2 


17 


16 


17 


18 


17 


17 


3 


20 


18 


18 


20 


18 


18 


4 


16 


19 


19 


19 


19 


19 


5 


18 


21 


20 


17 


20 


20 


6 


21 


20 


21 


21 


21 


21 



V> 
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The table is by now self explanatory. The additional benefits gained by some age 
groups in comparison to 16 year olds (see Table .4.8) are not sufficient to overcome the 
additional training costs. This is particularly true in Women’s Centers and in Conservation 
Centers where 16 year olds make a particularly strong showing. In the heavily skill training 
orien ed Men’s Center, 16 and 17 year olds prove to be the most cost beneficial group. The 
longer length and therefore greater training cost is not paying off sufficiently for the other 
age groups. 

Age— Another Scale: 

The problem with the young corpsmen is the difficulty encountered in placing 
them in jobs. It has been determined that an additional criterion scale would be 
examined to see if it could reverse these disconcerting results. The new scale is simple 
and direct. It contains two categories for terminecs; those placed and those not placed. 

Based on this scale the results in Table 4.9 have been confirmed. In particular, it 
has been determined that 16 and 17 year olds have rank one and two respectively for all 
three center types. 

Age- A Different Cost Model: 

The issue of setup costs is examined again in this case. A setup cost of $400 per 
corpsman is added to each enrollee’s cost of training. Such a load tends to penalize low 
length of stay, high turnover groups. The results are significant. On Scale I for Conservation 
Centers 16 and 17 year olds simply exchange position at the top of the ranking. For Men’s 
Centers on Scale II, 16 and 17 year olds drop one place in the rankings. Again 
as in the opening example, neither the scale nor reasonable alternatives to the cost model 
seem to affect the rankings substantially. 

Other Program Considerations: 

As in the case of the population investigation above, these studies are most mean- 
ingful if the factor under consideration is examined within center type. Cost benefit’, rank- 
ings of center size and placing agent fellow. 
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Center Size: 



Center size is not examined for conservation centers since large and small centers 
have become indistinguishable. For Men’s Centers, medium sized centers prove most cost 
beneficial on both scales. For Women’s Centers, the larger centers are most beneficial under 
Scale I, and under Scale II medium centers are most cost beneficial. In the ease of both 
Men’s and Women’s Centers, small centers are beaten at levels one and two indicating an 
overall poor performance by small centers. 

Placing Agent: 

The most cost beneficial placing agent is the corpsman himself. If one chooses to 
exclude this case, then either the local emplyment service or the center makes a strong 
showing in the case of Men’s Centers. For Women’s Centers, no clear pattern develops. In 
the case of Conservation Centers, the youth opportunity centers are second only to the 
corpsman himself. This particular comparison may be slightly spurious since appropriate 
cost data is not available and Scales I and II as designed are not particularly appropriate. 
Hence, these particular results should be considered as “indicators'’ only. 

Women’s Centers: 

Center by center comparisons arc made for Women's programs both from the view 
of effectiveness and cost benefit. The same type of analysis provided for men’s centers is 
appropriate for women’s centers. Since less information concerning previous rankings is 
available, the women’s center results are provided here without extensive comment. 

Table 4,10 summarizes the overall rankings for both studies with and without 
cost considerations. Complete data including individual center comparisons and a third 
scale, placed-unplaced, are provided in Volume II. 

Conservation Centers: 

The present scales are not used to rank Conservation Centers. The difficulties are 
two fold. The small size of Conservation Centers makes it such that the data becomes 
insufficient for an eight point scale. That is, the number of terminces in each cell of the 
scale is so small that interpretation of the results would be dangerous. Further, the two 
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scales used do not give adequate treatment to program transfers. These transfers are a 
significant part of all terminees from conservation centers. 

A new scale, especially appropriate for this case, has been prepared and analysis is 
proceeding while this report is being completed. The results of this investigation will be 
reported as an addendum to the study as soon as it is completed. 



TABLE 4.10 

Overall Effectiveness and Cost Benefit Rankings for Women’s Centers 

On Scale 1 and Scale II 



COST BENEFITS Effectiveness 

RANK Scale I Scale II Scale I Scale II 



1 


NAT YWCA 


NAT YWCA 


NAT YWCA 


NAT YWCA 


2 


TON POINT 


TON POINT 


EXCELAP 


KEYSTONE 


3 


ALBUQUE 


MCKINNEY 


POLAND SP 


EXCELAP 


4 


MCKINNEY 


KEYSTONE 


KEYSTONE 


LOS ANG 


5 


HUNTTON 


ALBUQUE 


LOS ANG 


CHARLESTN 


6 


POLAND SP 


HUNTTON 


CHARLESTN 


MCKINNEY 


7 


MOSESLAKE 


OMAHA 


ALBUQUE 


POLAND SP 


8 


OMAHA 


JER CITY 


ST LOUIS 


ALBUQUE 


9 


KEYSTONE 


MOSESLAKE 


OMAHA 


OMAHA 


10 


CLINTON 


POLAND SP 


GUTHRIE 


ST LOUIS 


11 


JER CITY 


EXCELAP 


TON POINT 


CLEVELAND 


12 


EXCELAP 


CLINTON 


MCKINNEY 


TON POINT 


13 


MARQUETTE 


CHARLESTN 


CLINTON 


GUTHRIE 


14 


CHARLESTN 


ST LOUIS 


CLEVELND 


CLINTON 


15 


LOS ANG 


LOS ANG 


HUNTTON 


HUNTTON 


16 


ST LOUIS 


CLEVELAND 


MARQUETTE 


JER CITY 


17- 


GUTHRIE 


GUTHRIE 


MOSESLAKE 


MOSESLAKE 


18 


CLEVELND 


MARQUETTE 


JER CITY 


MARQUETTE 
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Section V 



SUMMARY AND CONCLUSIONS 

The study just described represents the first application of a new procedure for 
making cost benefits comparisons. It is especially suited to education, training and social 
programs, where it is traditionally difficult to measure the true product of a program and 
therefore establish benefit or value for its participants. The difficulties associated with 
determining program benefit, along with arguments that cost is not a reasonable factor to 
be used in making program decisions, has led to a historical absence of cost benefit 
studies in this field. 

The uniqueness of this investigation rests not only in its consideration ol cost per 
terminee benefit but also in the procedure used to make program comparisons. The 
problem of assigning benefit weights is resolved. The procedure assumes, initially, no 
knowledge of the benefits and then passes tlirough an iterative mathematical process. 
Increasing assumptions concerning the benefit weights are applied until a decision be- 
tween two programs can be reached. The model and this procedure are discussed more 
completely in the Introduction to this volume and are treated mathematically in Section 
II of Volume II of ttiis report. 

Extensive examination of the model included empirical validation. During the 
process of this investigation it was determined that the procedure is sound and applicable 
to a situation in which manpower training programs are compared. 

The application of the technique to Job Corps data files provided some initially 
startling results. In several instances, programs which historically had been considered, 
and demonstrated, exceptional were found to he less desirable in light of costs. Further, 
an examination of enrollee groups proved to be no less startling. It has been well 
documented in previous studies of Job Corps that Negro corpsmen have better perform- 
ance records than whites: that younger corpsmen are more likely to do poorly in the 



program, and that youth from rural areas will perform more poorly than urban and 
metropolitan youth. This investigation reversed the latter two “knowns”. Additionally, 
earlier conclusions concerning racial groups were reversed when heavily oriented placement 
scales were used as criterion. 

The primary issue was one of diminishing returns. Length of stay has been used as 
an indicator of program success. It was logically assumed that increased benefits would 
result from increased length of stay. Hence one of the primary measures of program 
success was length of stay. However, associated with increased length of stay is increased 
cost of training. This increased cost of training was not offset by relatively increasing 
benefits. The question ol optimal length of slay naturally arises. Is it possible that thece 
is a point in the average corpsman’s tenure when maximum benefits per dollar invested 
have been obtained? 

In analyzing this set of findings two methodological issues which might have 
produced spurious results were carefully examined. 

Could it be that an inappropriate cost model had been selected? Or. was it 
possible that the criterion categories selected were inadequate? In particular, had inade- 
quate treatment been given to fixed costs such as transportation and orientation? Ex- 
clusion of these costs might benefit centers with high turnover rates. Several alternative 
cost models which paid specific attention to these cost issues were examined. Only when 
unrealistically structured examples were considered was there any evidence of an a f feet 
on the rankings. 

Several alternative criteiion scales were also examined, each of the scales being 
based on a slightly different program philosophy. Only in selected instances did the 
criterion scales used prove important. One instance of this was the racial comparison 
where Negro youth proved to gain more benefit per dollar spent on a program based 
scale, and white youth gained more per dollar spent according to a placement based scale. 
Additional scales included a regionally adjusted wage scale. This scale also proved to have 
essentially similar results (see appendix). 

With more refined measures: e.g.. enter on scales, comes greater power. If one can 
determine the specific weights associated with each of the categories of this refined scale. 
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then the maximum power of the cost benefits technique is achieved. It is highly 
improbable that accurate weights can be determined; hence the usefulness of the technique 
described in this report is demonstrated. It is possible, though, to improve the definition ol 
outcome categories by making them more appropriate to Job Corps objectives. It is this 
later effort in which enery should be expended. 

What are the skills that we expect an individual to achieve in a manpower training 
program? Can we define levels of attainment? These refinements in defining criterion 
scales are important not only to cost benefits analyses, but to any analysis which 
compares programs or examines questions of relative program impact. 
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Appendix 

VERIFICATION OF OUTCOME SCALES 



In Addition to the two outcome scales analyzed in this report, three other Scales 3, 
4, and 5 were developed and applied against the source data. The purpose in doing this was 
to verify the results of Scales I and 2. 



Seale 3 was essentially a collapsing of Scale 2, into a category labeled “unplaced in a 
job” and another category labeled “placed in a job.” “Placed” and “unplaced” have always 
been common measures of program success in Job Corps, so verification using this scale was 
felt to be essential. 



Scale 4 was again similar to Scale 2, except that transfers were considered separately 
and placed in the highest category. This scale was only applicable to Conservation Centers 
and reflects the desirability of preparing Corpsmen in Conservations Centers for entrance 
into Men Centers. 



Scale 5 was solely economic, based on attained starting wage after benefiting from 
Job Corps training. Category I membership included all unplaced corpsinembers and those 
placed at wages less than $1.00 per hour. Category 2 included those who were placed at a 
wage between $1.01 and $1.60 an hour. In Category 3 were those with hourly wages 
between $1.60 and .$2.25. In Category 4 were those who started with more than $2.25 an 
hour. All wages were adjusted by economic factors to take into account wage differentials 
by state. That is, a laborer in New York State almost certainly will start at a high rate than 
his counterpart in Alabama, and this difference must be eliminated in order to enable 
comparisons to be made without bias. 

Cost benefit rankings developed from these three scales and have been submitted to 
Job Corps. In general the rankings support the results presented within this report. None of 
these scales results in any reversals of previously mentioned results, which tends to validate 
the Scales I and 2. Nevertheless, the conscientious analyst must continually seek better 
measures of program objectives, particularly when the data base is nation-wide so that the 
details of individual program training are extremely difficult to represent with measurable 
outcomes. 
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A JOB CORPS STUDY OF 
RELATIVE COST BENEFITS 



VOLUME II 



RESULT HIGHLIGHTS 



1 . Several previously established “bctterness” conclusions were reversed when 
costs per program termince were considered. Examining only absolute effectiveness, older 
corpsmen have traditionally proven to do better in Job Corps than younger enrollees(l6 
and 17 year olds). Similarly youth from large cities have as a group stayed longer in the 
program and had better placement records. Gary Job Corps Center has proven to be one 
of the more effective Men’s Centers. These three results in particular have been reversed 
or at least questioned under scrutiny of cost per terminee. 

The question underlying all three of these reversals is the relative benefit of a long 
tenure in Job Corps. In each case, the reversal was a direct result of increased costs 
resulting from a long time spent in the program. 

2. Examining the age phenomenon as a function of type of center indicates that 
Conservation Centers (small rural men’s programs) prove to be more effective with young 
corpsmen than the larger urban Men’s Center programs. 

3. As might be expected, the large Men’s Centers prove most effective with 
corpsmen from large cities and metropolitan areas. Similar results are achieved for 
Women’s Centers (generally located in urban areas). Conservation Centers are most effec- 
tive with rural youth. (All centers prove more cost effective with rural youth- a function 
of length of stay and diminishing benefit?). 

4. Regional differences exist, but they appear to be a result of centers located in 
the region. Job Corps policy is to locate corpsmen in centers near home hence youth 
are typically enrolled in centers located within their home region. 

5. Cost benefit rankings were suprisingly constant across criterion scales. Typ- 
ically results achieved under the assumptions of one scale replicated when alternative 
scales were considered. 



6. A linear cost model proved sufficient lor the analysis. An examination of set 
up costs, including travel, proved incidental. The cost of transporting a corpsman to and 
from a center and orienting him/her is very small when compared to the average cost of 
training. 

7. Interesting and confirming results were achieved when corpsmember race was 
considered. Negro corpsmembers generally performed better in terms of the effectiveness 
indicators considered. But. when cost effectiveness was examined, centers proved less 
cost beneficial with Negro youth, when a heavily placement oriented scale was considered, 
than with white youth. This indicates that even federal or regionally oriented programs 
have not solved the employment problem for Black terminecs. This is confirmed when 
the results of the non-placement oriented scale are examined. This latter scale indicates 
that within the program the Negro corpsmembers prove to be a cost-beneficial group. 

Each of the highlights treated above are examined in more detail in Section IV of 
this report. 



Section I 



INTRODUCTION 

Volume II of tli is report contains a detailed presentation of the data which 
supports the results discussed in Volume I. The tables, contained in Section 11!, are 
presented essentially without comment except where it is necessary to clarify codes. 

Each table in Section 111 examines all the individual comparisons which support a 
given ranking. For example, supporting the relative ranking of the six age groups are 
fifteen comparisons where the position of each group is considered relative to each of the 
others. Before 16 year olds can be established as having rank one, it must lie compared 
not only to 17 year olds but also IS, 19, 20 and 21 year olds. 

The purpose of this examination is to determine the level of assumption necessary 
before it is possible to accept the superiority of 16 year olds as far as cost benefit is 
concerned. For each comparison in the tables the arabic number represents the level of 
assumption necessary in the convex case, and the roman number identifies the conditions 
if the benefits curve is assumed concave. This notation is identical to that used in 
Volume 1. It might be useful to review the detailed explanation of the levels of 
assumption and the interpretation rules outlined in the first part of Volume 1, Section 
111, the results section. 

For those mathematically inclined the mathematics underlying the procedure used 
in this investigation is presented in Section II. It should be noted that it is not easy 
reading but it is fully complete. The non-mathematieal reader may prefer to review again 
the methodology portion of Section 1 (Introduction) and the first part of the results 

I 

section in Volume I. , 

The mathematics has been taken with only minor modification from a paper (as 
yet unpublished) by B. Allen Benn and Gilmore S. Wheeler entitled “Relative Cost 
Benefit” in which the procedure was first developed. 



The essence of the model is an iterative procedure in which one places greater and 
greater restrictions on the nature of the benefits curve until a cost benefits based decision 
among programs can be made. The initial assumptions place no requirements upon the 
values and benefits. It is assumed that there exists no knowledge nor even a philosophy 
which would give a clue to theii nature. Failure to force a decision at a low level of 
assumption requires additional iteration until a decision is reached. The highest level is a 
linear assumption. A decision is always reached in this final case. 

A review of the highlights of this study will help put the tables presented in 
Section II in some focus. The highlights preceed this Introduction. 



Section II 

THE MATHEMATICS OF THE MODEL 

In many social/educational programs data bases are being maintained which 
contain biographical information on each individual (e.g . , age, months in school, broken 
home life?, home state, race, etc.). In addition to this information, performance data of 
some form are generally available (e.g., test scores, ratings, final classification). After 
“benefiting” to some extent from the program, the condition of a participant’s departure 
is recorded to complete his record. Usually more than one or two possible conditions of 
departure are recorded. For some programs, a great deal of intermediate results informa- 
tion is added to records as the program progresses. 

For the moment, then, let us suppose there are exactly eight possible recorded 
outcomes which can be associated with any participant upon completing a program. An 
individual assigned to a particular program eventually will have exactly one recorded 
outcome, or result, k=l,...,8. At this point we would like to assume that in corre- 
spondence with each distinct recorded outcome k there is a non-negative benefit to 
society, b^, which is independent of both the particular program in which the individual 
was enrolled and of particular characteristics of the individual. The achievement of 
the kth outcome is expected to depend on personal characteristics, but once there, 
the participants’ associated benefit may no longer depend materially on his charac- 
teristics. 

With our model in which each recorded outcome is associated with a benefit, we 
seek a means for comparing how well an individual might do in each program, taking into 
account varying costs of the program. If this problem can be solved, there exists a natural 
extension to target populations. This in turn leads to possible program or training center 
comparisons, and perhaps even to algorithms for purposes of optimal allocation of 
resources. 
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We still have to decide how to combine known costs and abstract benefits. 

Let B denote the associated benefit to be achieved .by a new enrollee upon com- 
pletion of his training. B is a random variable due to the lack of certainty concerning 
which outcome k will obtain. Since benefit is in fact an authentic social utility by 
assumption, it suffices to consider maximizing in some sense an expected benefit, E(B). 
The problem is that cost is also a random variable, depending perhaps on out- 

come k as well as the individual, and certainly 01 the program. 

The power in whatever we will be able to assert about relative merits of programs 
with reference to a particular traget population will depend in effect on what can be 
asserted about the program impact on individuals. The functional form to apply at the 
individual level, therefore, must he in agreement with overall goals, the highest of which 

would be optimal allocation of scarce resources over all programs. It is natural for tl is 

reason to start with an abstract formulation for optimal allocation of resources, work 
down to the individual level, evaluate parameters and work back up to the appropriate 
level for decision-making. The ranking of programs or training centers is a good place to 
stop for most management purposes. 

Before we continue much farther, some ad litional notation needs to be agreed 
upon and these and other basic assumptions and goals made explicit. 

Throughout, upper case letters denote random variables and lower case either 
realization of random variables or variables known with certainty. (See the attached 
glossary for clarification of notation.) 

Let Nj (sj/Tj) be a random variable denoting the number who can be trained 
through the jth program with funds Sj given a known population, Tj, from which 
cnrollees arc selected at random with replacements . 1 Total benefits, Bj, associated with 
Nj is a function of both Nj and Tj. By letting L denote the expectation 
operator, we can now state the allocation problem: Over the set of programs within the 
system, determine an optimal allocution by means of maximizing 




0 ) 



*That is, T is invariant from one selection to the next. Although this is essentially true in practice, 
this formulation is based solely on convenience. 



Subject to 




< s where 



s 



is the bound on dollar resource. 



Fix Sj and Tj and consider the random variable Nj. With each indivi- 
dual 1, 1=1,..., Nj, there is a benefit Bj^^l/Tj) which again is a random variable. 
Since each person is randomly picked from Tj, each Bj^^(l/Tj) is indentieaily 
distributed, for 1=1,..., Nj, say as the random variable Bj(l/Tj). Therefore, the total 
benefit for Program j is given by 



BjCNj/Tj) = Z B/Do/rp 
1=1 



( 2 ) 



a compound random variable, which is known to have expected value given by 



E | Bj(Nj/Tj) 



u 

1 




B/I/Tp 




(3) 



This means that the solution to (1) can be found by differentiating forms like (3) with 
respect to Sj and solving the following equation for each program: 

( | *{w( 

E { BjO/T,) = X (4) 

l 1 M 3 s j 



Where X is the Lagrange multiplier for temporarily relaxing the constraint Sj<3. 
Each function E | 'Nj(Sj/Xj) | will be differentiable in practice since a differentiable 
form will be chosen that fits historical data empitomizing results of allocating variable 
funds to existing programs. 

It should be noted that with constant returns to scale, Equation (4) cannot be 
solved for Sj. In this case the optimal solution is to load all the s into the program 
with the highest E | Bj(Nj/Tj)| given by (3). To the practitioner, however, such a 
solution (rather than the underlying assumption) is absurd so instead we recommend 
ranking the programs using Equation (3). Administrators are naturally concerned about 
programs with 1 owp«» rank. With constant returns to scale, E |^j(Sj/Tj)| takes the 

dE j Nj(s:)/Tj) 

form aj(Tj)Sj + dj, so that L- 1 becomes aj(Tj). It is interesting to observe 
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the meaning of aj(Tj) ; it is the inverse of the e ;pected average participant cost with 
respect to the population Tj. This simple case therefore reduces the consideration of 
expected benefits in the form 



E | Bj(Nj/Tj) j 



K ( BjO/Tj. j 


average Program j benefit 


E J(cost/individual/Tj)| 


average Program j cost 



Generally returns to scale are not constant but increasing. E j Nj(Sj/Tj) j can 
be estimated from historical data, since expenditures are usually on an accrual basis with 
monthly financihl reports, and the number and characteristics of individuals arc known at 
any point in time. The point is there is nothing fundamentally difficult about this 
process, since it involves estimating a measurable quantity, number of people, on the 
basis of other equally measurable quantities such as level of spending. The factor 
E | BjO/Tj) | is far more intangible because it involves benefits. 



Observe that even in the most general case of Equation (4), the factor 
3 E | Nj(s/Tj) | Id s is a constant, j3j, for sj and Tj fixed; and we are led to the 
need to develop ways to decide whether or not 



Pi E 



Bjf 1 /Tj) } = X 



(5) 



If an allocation of funds exists such that S s j = s and’ * or 
k, |3jE | Bj(l/Tj) j = |3| C E | 1 /T k ^ | * Men (5) is satisfied for each j 

constraint is also satisfied, the allocation is a solution to (1). 



and j and 
and, as the 



Unfortunately the statement “|3jE | Bj( 1 /Tj) J = ,0 k E |bj < (I/Tj < )| ” is ex- 

tremely difficult to make with much assurance l>e cause its extreme sensitivity to error in 
the fact of the unknown nature of the benefits bj, associated with each outcome 
category, i=l, . . . ,r. Whereas the statement “(3jE | Bj(l/Tj) J > ^E | 1 /T^) | ” 

often times can be made with great assurance. When the latter occurs we say Program j 
has more, or at least as much, cost benefit than Program k, with respect to the target 
populations Tj and T^, even though they generally are marginal benefits. With con- 
stant returns to scale, our nomenclature becomes exact. 
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With the above in mind, our approach (whether it is an allocation or ranking 
program to be solved) will be to compare two programs with the purpose of determining 
which has highest cost-benefit. If the determination results only from assumptions of 
non-negativity, then no limiting restrictions are placed on the bj, and there can be little 
question concerning the result. Gradually more restrictions will be placed on the form 
of bjS until either one program is said to have higher cost-benefit than the other, or 
they appear equal. The increasing assumptions on the shape of the benefits curve serve, 
along with a certain computed coefficient of separation, to provide an intuitive feel for 
the relative closeness of ranked outcomes. Further, the probability of error can be 
computed and unacceptable error risks eliminated. 

What we will do, then, is to develop equivalent (mathematically) definitions based 
upon relatively non-restrictive and intuitively obvious assumptions about the shape of the 
unknown benefits curve. These assumptions will always obviate the necessity of knowing 
the precise (absolute) value of membership in a given outcome state. 



The first part of this section deals with the algebra of comparing forms like 



PE | B(l/T) j , when P depends on the combination involving a program and al- 
located resources. A series of theorems and corresponding assumptions are presented as a 
foundation for discriminating between any two programs. The second part condenses the 
theory to a table of test conditions and an algorithm for use in practice. 

A. General 

Program A is said to be at least as cost-beneficial as Program B (denoted A > B) 
for P ^ and |3g given with reference to target population T^ and Tg, if 



MATHEMATICS 




ERIC 
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Let P(k/A,T A ), k=l, 
random selection from 



. ,r, denote the probability that outcome k occurs for a 
T A under Program A, and similarly for Program B. 



Theorem 1 : 

2, A > B if for each k=2, . . . , r 
0 A P(k/A, T a ) > /3 u P(k/B, T b ) 

r r 

Proof: /3 a E (b a ( 1/T a >| = p A £ b k Wk/A. T A ) - P A £ b k ttk/A. T A ) since b, s 0 

k=I k=2 

But for each k=2, . . . , r. /3 A P(k/A, T A ) S' 0 B P(k/B, T B ) implies 
that p A b k Pfk/A, T a ) > 0 B h k Ffk/B. T B ) so that 

L 

0 A E ! b A<!/T a )] >P b Z b k Kk/B,T B )=(3 B L j B B ( 1 /T B ) } 

Assumption 1 : The benefits are rank ordered so that bj < bj + j, i=l , . . . ,r-l. 

The following are two theorems known for benefit only (ref. 5); that is, excluding 
the factors P A and 0 B AB |i 0U gh slight modification is all that is required for our 
purpose, the proof of Theorem 2 is presented for later use. Theorem 4 complements 
Theorem 3, and is proved using an approach which complements that for Theorem 3. 



Lemma 1 : (Abel’s Summation Identity) 

For two arbitrary sequenees of numbers: 



( a i } Z and ( b i) z 

( ’ i=l ‘ ' i=l 



n n-1 

Z -A ■ I 

i=l i=l 



(Z a i) (Vl ' b i) 

j=i=l 



n 

- z 

j=1 



Ujbj 



Remarks: 

That Abel’s identity is obvious follows by analogy to the continuous case 
with a, and be functions, whose product is to be integrated, and the technique chosen 



K 



in integration by parts. The theory below therefore extends to continuous outcome scales 
as well, except that for nontrivial results concentration at zero is necessary. 



Theorem 2: 

With Assumptions 1 , A > B if for each i=2, . . . , r the following occurs 

r r 

P A £ P(j/A,T )>p £ Pfj/B.T) 

k=l k=2 



Proof : v 

r r 

The theorem is true if 0 A bjP(i/ A, T A ) > 0g ^ bjP(i/B, Tg) 

i=l i=l 

r 

iff Z b i [a A P(VA,T A )-^ B P(i/B,T B )] >o 
i=l 



(by Lemma 1) 

r-l ( 

Z Z 

i=l (j=i+l 
r 

+ Z [/J A PO/A, T a ) - /JgPU/B, Tg)] b,>o 

J=1 



[/3 A P(j/A, T a ) - 0gP(j/B, Tg)] [b i+ , - bj] , 



(by the zero point condition of the definiation of bi) 
r- 1 r 

iff Z Z [f»A«i/A, T a ) • 0 B >W. T B>] [ b i+l • b i] > 0 
i=l j=l + l 



( 6 ) 



(7) 



( 8 ) 



But by Assumption 1, bj + ] ■ b 0 for each i=l, . . . , r-l, so that the last inequality 
holds if each multiplier is non-negative. That is, for i=2, . . , r 

Z 0 A W*. T a ) - 0 B P(j/B. T B ) j >0 



which proves the theorem- 



T 
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Assumption 2: The sequence of benefits { bj } is convex, Le., there is positive accelera- 
tion, Ab, = b i+ , • bj> bj - bj.j for i=2, r-1. With this assumption Abj behaves as bj 

in Assumption 1. This means in effect that Abel’s identity can be reapplied, which leads 

to: 

Theorem 3: 

i n if fnr each i = l • ,r*l tor the following 

With Assumption 1 and 2, A 3> b it tor cacn i » 

condition obtains 



r-1 

c A Z 

j=i k=j+ 1 



r-1 



V P(k/A,T A )>% £ X P(k/B, T b ) 

^ j=i k=j+l 



Assumption 3: The sequence of benefits |b|| is concave, Le., negatively accelerated 
Abj < Abj.j i=2, .... r-1. 

Theorem 4: 

With Assumptions 1 and 3, A > B if for each i-1, r-1 the following 

conditions obtains 

i r 4 

Pa 



y y P(k/A, T a ) > /3b S X P(k/B ’ Tr) 

p\ k=j+l J* 1 k= j +l 



Proof: 



Recalling the proof of Theorem 2, the theorem is true with Assumption 1 if 
inequality 8 holds. Since an equivalent form of Abel’s Identity is: for aj, bj arbitrary 
n n-1 [ i 

Z Z a i)(v b »i) 



i=l i=l I j=l 

inequality 8 can be rewritten as 

r- 2 



+ z a j b " 

i-i 



I*)) 



z 

i=l 



£ 2 I" |S A Wk/A,T A )-J B lWB,T B ) 

j=l k=j+l L. 



r-1 r 

- Z Z 

j=l k=j+l 



/3 A P(k/A, T a ) - 0 B P(k/B, T B ) Ab r-1 



(Abj - Ab i+ j) 

( 10 ) 



> 0 
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Now by Assumption 3 each factor Abj - Abj + | > 0 and. by Assumption I. Ab r _ j 0. 

so that it suffices for each coefficient to be non-negative. That is. for i=l r-l, 

i r 

Z Z 0A P(k / A - T A> ■ WW. T b ) 

i-l k=i+l . 

The developments so far are not in themselves a complete theory. The reason is that in 
practice a small but significant number of cases none of the theorems can be invoked. 
That is to say, the conditions in the theorems are sufficient but riot necessary. 



0 



(M) 



When it occurs that none of the theorem applies, most administrators arc willing 
to add even more restrictions in order to separate the programs in question, even at the 
risk of possible error. 



A theory is needed that maintains the essence of Theorems I through 4, but 
which can be invoked with far fewer limitation. One answer which works nicely in 
practice is to further restrict the form of the tys to a quadratic function in i, of the 
form 

bj = a(i-l) + b(i-l) 2 



for i~l,.. . ,r. The coefficients a and b are aibitrary with the sole restriction that 
each b > 0. In addition, let us require the Assumption 1 be satisfied as well, so that 
the bj are non-decreasing. Thus Theorems 1, 2 and 3 apply automatically if they can 
be invoked, as does the appropriate Theorem 4 or 5, But more specialized Theorems can 
be developed as well. 



Definition 2: 

The mean and variance of program outcomes with respect to a target population 



are defined as: 



^A = 




(i-l )P(i/A, T a ) 



Lemma 2: 

If the 



r 

“a 1 - Z o-HA-n’ro/A, t a > 

i=l 

bj are quadratic in i, and with Assumption I, A> B iff 
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a [^A (o A J + M A 2 ) * % (a B 2 + ^B 1 )] + b [^A * A ' Pb ^b] ^ ° (12) 



Proof: 



The lemma is true iff 0 A £ bjP(i/A, T A ) > 0 B Z bjPfi/B, T B ) 

i=l i=l 



iff 0 A X ('-1) 2 P('/A, T a ) + /3 A b £ (i-l)P(i/A, T A ) 

i=l 



1=1 



>0 B a X (i*l) 2 I‘(i/B, T b ) + 0 B b £ P(i/ B , T B > 
i=l i=l 

iff a [p A (a A 2 + M A 2 ) - 0 B (a B 2 + M B 2 )] + ^A^A'P^b] > ° (,3) 

Theorem 5: 

With the setting of Lemma 2, A > B if either I, II, III or IV occur. 

I. i) a < o 

and ii)0 A M A > 0 B M B 

and iii)|3 A ^(2r-3) M A - (o A 2 + M A 2 )j ^ Pb |(2r-3) /i B - (a fi 2 + M B 2 )J 



II. i) b < o 

and ii)|3 A (a A 2 + n^ 2 ) > Pb (o B 2 *■ M B 2 ) 

and iii)|3 A [o A 2 + M A 2 - M A ] > 0 B 2 [<> B 2 + M B 2 * M B ] 

HI. i) a > o, b > o 

and ii)|3 A MA > 0B^B 

and iii)|3 A (o A 2 + m A 2 ) ^ 0 B (° B 2 + ^B 2 ) 



(14) 



(15) 



IV. i) a=o 

and ii) |3 a m A > Pb^B 



O 
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Proof : 



l. Assume a<o; that is, the benefit function is concave, in order that benefits 
remain non-decreasing throughout the range of outcomes, 

a( r~ 1 ) 2 + b(r-l) 2* a(r-2) 2 + b( r- 2 ) (16) 

since the cl I’ect of a negative second order term is extreme at the highest outcome. This 
means that 



(17) 



( 18 ) 



a(2r-3) + b > o / 

or b 3* -u(2r-3) 
v 

From inequality (13), we know the theorem holds iff 

a [0A (o A 2 + (V > ' 0B <°B 2 + ^B 2 >] + b [^Va ' <Vb] > ° 

By (I,ii) the factor multiplying b is non-negative so that the left hand side of (18) is 

> a [0 A (a A 2 + M A 2 ) - 0 B (« B 2 + ^B 2 >] ' a(2r ‘ 3 > [^A ' ^B^B 
= -a j(2r-3) [p A P A - - P A (o A 2 + M A J ) + 0 U (o B 2 + p b 2 )J (W) 

Expression (19) is non-negative, since -a >o, if the expression within the braces exceeds 
zero, which establishes the meaningfulness of (l.iii). 

i 

II. Assume b<o; hence, for bj > o, a > o, so that the benefit function is a 

special case of convex parabola. In addition, to prevent bj < o, it is clear that 

b 2 = a+b 3* o 

or a > -b < 2U > 



With (I,ii), th erefore, the left hand side of (18) is 

> - l [pA (<j A 2 + ^A 2) • % (o B 2 + HB*>] + b2 [^A - ^b] 

= ' b (PA [ f; A 2 + ^A 2 * Ma] ’ % [°B 2 + ‘ M„]} 

3* o 

since -b > o and (Il,iii), establishing (Il.iii). 

III. &. IV. Assume a>o and b > o, so from inequality 18 conditions (Ill.ii) and 
(Ill.iii) obviously obtain. If a=o then b > o, and, again by inequality 18, (IV,ii) 
follows, completing the proof. 
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B. Summary 

Application of the theory just developed depends as much on objectives of any 
analysis as on the form of the data base. Oftentimes, it is appropriate to make the 
simplifying assumptions that input populations are homogeneous for all programs within a 
stratum under consideration 1 and that program costs vary linearly with the number of 
participants in the program. As we saw before, the latter leads to the study of average 
benefits to average costs. With this setting it is convenient to illustrate the condition in a 
compact form for testing the relative cost-benefit of one program to another. Table 1, 
contains all letels of restrictions placed on the benefits with corresponding test 
conditions for sufficiency conditions guaranteeing that A > B. All parameters in the 
table have been previously defined except and Cg which represent unit costs 

of Programs A and B, respectively (the inverses of /3^ and /3y). The convex strictly 
parabolic test conditions are for both b > o and b < o simultaneously, and follow 
easily by combining parts II and III of Theorem 5. 

The ranking algorythm above has been programmed in FORTRAN on an IBM 
1130 with 8K core storage and a disk and can handle up to 1 10 programs at one time. 
An added feature of the program is an option to treat outcome history as a sample of 
some statistical population,, rather th in as fact. With the option, statistical tests 
appropriate to each level of test condition are invoked. For example, for levels 0, 1, and 
2, A>B is considered statistically valid if for each category comparison the null 
hypothesis of “equally” is rejected in favor of “inequality.” Since this requires consid- 
eration of a single category at a time, the appropriate statistical test becomes similar to a 
simple one-way contingency table, complicated only by the necessity for including costs. 



*Or that input populations are heterogeneous, but they are assumed to remain that way, and 
the manager may want to compare programs on the basis of accomplishment without reflecting target 
population differences. 
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TABLE I 



Restrictions and Test Conditions 



LEVEL 


RESTRICTIONS 


TEST CONDITIONS 


0 


bj > o, i=2, . . . , r 


P(i/A)/C A > P(i/B)/C B , i=2 r 


1 


bj > bj. j > o, i=2, . . . , r 


t 

1 ^ 1 r 

C A Z- P 07A)^C B £ P(j/B), i=2 r 

j=i j=i 


2a 

(convex) 


bj > bj_j > o, i=2, . . . , r 
and Abj = bj + 1 - bj > bj - 
bj.j, i=2, . . . , r-1 


1 r- 1 r | r- 1 r 

C A Z Z P(k/A)>r B Z Z P(k/B) 

j=i k=j+l j=i k=j+l 


2b 

(concave) 

1 


bj > bj.j > o, i=2 r 

and Abj < Abj. j 
i=2, . . . , r-1 


i 1 r i ' r 

C A Z Z P<k/A) > C B Z Z P(k/B) 

j=l k=j+l j=l k=j+l 


3a 

(convex 

strictly 

parabolic) 


bj = a(i-l) 2 + b(i-l) 
with a > o 


0 1 1 
C A "A > C B "B 

M> TT a [°a 2 + "A 2 -, A ]> r„[V + "B 2 - bb] 


3b 

(concave 

strictly 

parabolic) 


bj = a(i-l) 2 + b(i-l) 
with a > o 


0 ^ 

'■'A t “B 

H) Jr f(2r-3) ka • «. A 2 + * A 2 >| 

C A L J 

> i [( 2r - 3) ■ (o B 2 + /i B 2 )] 


4 

(linear) 


bj = b(i-l) 


i- ^A > jr ^B 

c A C B 
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GLOSSARY 

bj is defhcd us the benefit associated with any obtained category i=l, . . . ,r. bj has a 
zero point, corresponding to an category 1, indicating no improvement, bj is 
non-negative, i.e., benefits are never negative in value. Although it could be argued 
that an*, individual might use learning in anti-social ways, and thus give bj a 
negative value, for purposes of this model, learning is considered positive. 

Bj is defined as the benefit associated with training an individual, with the specific 
outcome to be determined upon completion of training. B is a rar dom variable, 
because it is uncertain which outcome the individual will achieve. 

Sj is defined as the amount of dollar resources to be allocated to the jth pro-' 
gram. Sj is a random variable because it is a function of the characteristics of 
participant individuals, of the specific program, and of the r’s acliieved. 

Tj is defined as the population characteristics of the participants to be trained with 
program j. 

Nj the number of participants to be trained with program j. 

Pfl denotes the probability of the event specified in the brackets. 

E[ ] denotes the expectation of the random variable specified in the brackets. 
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Section III 



COMPLETE RESULTS TABLES 



The tables which follow have been grouped by concept category. That is, all 
tables which deal with age are presented together, all tables which deal with city size are 
presented together and so on. 

Each Section is preceded by a brief explanation of the coding system used in the 
tables contained in that group. For a detailed discussion of how to read these tables see 
the discussion of Men's Centers which leads the results section in Volume I. (A portion 
of this discussion is reproduced as an appendix to this volume.) 

A complete listing of all tables follows: 

TABLE 

NUMBER TITLE 

3.1 Relative Cost Benefits Rankings for Age Comparisons Witliin Men’s Centers on 

Scale !-Standard- Cost Model 

3.2 Relative Cost Benefits Rankings for Age Comparisons Within Men’s Centers on 

Scale II Standard Cost Model 

3.3 Relative Cost Benefits Rankings for Age Comparisons Within Men’s Centers on 

Scale III— Standard Cost Model 

3.4 Relative Effectiveness Rankings for Age Comparisons Within Men’s Centers on 

Scale I Standard Cost Model 

3.5 Relative Effectiveness Rankings for Age Comparisons Within Men’s Centers on 

Scale II- Standard Cost Model 

3.6 Relative Cost Benefits Rankings for Age Comparisons Within Women’s Centers 

on Seale I Standard Cost Model 

3.7 Relative Cost Benefits Rankings for Age Comparisons Within Women's Centers 

on Scale II Standard Cost Model 

3.8 Relative Cost Benefits Rankings for Age Comparisons Within Women's Centers 

on Scale ill Standard Cost Model 

3.9 Relative Effectiveness Rankings for Age Comparisons Within Women's Centers 

on Scale I- Standard Cost Model 




TARI P 

NUMBER TITLE 

3.10 Relative Effectiveness Rankings for Age Comparisons Within Women’s Centers 

on Scale II- Standard Cost Model 

3.11 Relative Effectiveness Rankings for Age Comparisons Within Women’s 

Centers on Scale III Standard Cost Model 

3.12 Relative Cost Benefits Rankings for Age Comparisons Within Conservation 

Centers on Scale Standard Cost Model 

3.13 Relative Cost Benefits Rankings for Age C'omparisons Within Conservation 

Centers on Scale 1 Standard Cost Model 

3.14 Relative Cost Benefits Rankings for Age C'omparisons Within Conservation 

Centers on Seale 111 Standard Cost Model 

3.15 Relative Effectiveness Rankings for Age Comparisons Within Conservation 

Centers on Scale I Standard Cost Model 

3.16 Relative Effectiveness Rankings for Age Comparisons Within Conservation 

Centers on Scale II Standard Cost Model 

3.17 Relative Cost Benefits Rankings lor Age Comparisons Within All Centers on 

Scale I Standard Cost Model 

3.18 Relative Cost Benefits Rankings for Age Comparisons Within All Centers on 

Scale II Standard Cost Model 

3.19 Relative Cost Benefits Rankings for Age Comparisons Within Conservation 

Centers on Scale III Standard Cost Model 

3.20 Relative Cost Benefits Rankings for City Size Comparisons 

Centers on Scale 1 Standard Cost Model 

3.2! Relative Cost Benefits P<a likings for City Si/.e Comparisons 
Centers on Scale II Standard Cost Model 

3.22 Relative Cost Benefits Rankings for City Size Comparisons 

Centers on Seale III Standard Cost Model 

3.23 Relative Effectiveness Rankings for City Size Comparisons 

Centers on Scale I Standard Cost Model 

3.24 Relative Effectiveness Rankings for C ity Size Comparisons 

Centers on Scale II Standard Cost Model 

3.25 Relative Cost Benefits Rankings for City Size Comparisons Within Women’s 

Centers on Scale I Standard Cost Model 

3.26 Relative Cost Benefits Rankings lor City Si/.e C'omparisons Within Women’s 

Centers on Scale II Standard Cost Model 

3.27 Relative Cost Benefits Rankings for City .Si/.e Comparisons Within Women’s 

Centers on Seale 111 Standard Cost Model 

3.28 Relative Effectiveness Rankings for City Si/.e Comparisons Within Women’s 

Centers on Seale I Standard Cost Model 
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Within Men’s 
Within Men’s 
Within Men’s 
Within Men's 
Within Men’s 



TABLE 

NUMBER TITLE 

3.29 Relative Effectiveness Rankings for City Size Comparisons Within Women’s 

Centers on Seale II Standard Cost Model 

3.30 Relative Cost Benefits Rankings for City Size Comparisons Within Conserva- 

tion Centers on Seale I -Standard Cost Model 

3.31 Relative Cost Benefits Rankings for City Size Comparisons Within Conserva- 

tion Centers on Seale II Standard Cost Model 

3.32 Relative Cost Benefits Rankings for City Size Comparisons Within Conserva- 

tion Centers on Scale III Standard Cost Model 

3.33 Relative Effectiveness Rankings for City Size Comparisons Within Conserva- 

tion (.'enters on Scale I • Standard Cost Model 

3.34 Relative Effectiveness Rankings for City Size Comparisons Within Conserva- 

tion (.’enters on Seale II Standard Cost Model 

3.35 Relative Effectiveness Rankings for City Size Comparisons Within Conserva- 

tion Centers on Scale 111 Standard Cost Model 

3.36 Relative Cost Benefits Comparisons for Racial Groups Standard Cost Model 

3.37 Relative Cost Benefits Rankings for Race by City Size Comparisons Within 

Men’s (.enters on Seale 1 • Standard Cost Model 

3.38 Relative Cost Benefits Rankings for Race by City Size Comparisons Within 

Men’s Centers on Seale II Standard Cost Model 

3.39 Relative Cost Benefits Rankings for Race by City Size Comparisons Within 

Women’s Centers on Scale I -Standard Cost Model 

3.40 Relative Cost Benefits Rankings for Race by City Size Comparisons Within 

Women’s Centers on Seale II Standard Cost Model 

3.41 Relative Cost Benefits Rankings for Race by City Size Comparisons Within 

Conservation Centers on Scale I Standard Cost Model 

3.42 Relative Cost Benefits Rankings for Race by City Size Comparisons Within 

Conservation Centers on Seale 11 -Standard Cost Model 

3.43 Relative Cost Benefits Rankings for Race by City Size Comparisons Within All 

Centers on Seale I - Standard Cost Model 

3.44 Relative Cost Benefits Rankings for Race by City Size Comparisons Within All 

Centers on Seale II Standard Cost Model 

3.45 Relative Cost Benefits Rankings for Region Comparisons Within Men’s 

Center on Seale 1 Standard Cost Model 

3.46 Relative Cost Benefits Rankings for Region Comparisons Within Men’s 

Center on Seale il Standard Cost Model 

3.47 Relative Cost Benefits Rankings for Region Comparisons Within Women’s 

Centers on Seale I Standard Cost Model 



TABLE 

NUMBER 



TITLE 



3 48 Relative Cost Benefits Rankings for Region Comparisons Within Womens 
Centers on Scale II Standard Cost Model 

3 49 Relative Coat Benefits Rankings tor Region Comparisons Within 

Conservation Centers on Seale 1 -Standard Cost Model 

3.50 Relative Cost Benefits Rankings for Region Comparisons W.tlun 

Conservation Centers on Scale 11 Standard Cost o e 

3.51 Relative Cost Benefits Rankings for Region Comparisons Within All Centers 

on Scale II Standard Cost Model . , 

3 Relative Cost Benefits Rankings for Placing Agent Comparisons W.thm Men 

Centers on Scale I Standard Cost Model 

3 53 Relative Cos. Benefits Rankings for Placing Agent Comparisons Within Men s 
Centers on Scale II Standard Cost Model 

3 54 Relative Cos. Benefits Rankings for Placing Agent Comparisons Wtihm 

Women’s Centers on Scale 1 Standard Cost Model 
3 55 Relative Cos. Benefits Rankings for Placing Agen, Comparisons Wt.htn 

Women's Centers on Scale II Standard Cost Model 
3 56 Relative Cos. Benefi.s Rankings for Placing Agent Comparisons Wtihm 

Conservation Centers on Scale I Standard ( ost Model 

3 57 Relative Cos. Benefits Rankings for Placing Agent Comparisons Within 

3.57 RelJt ' , ' on ^° vat|on t ,„ lurs on Scale II Standard Cos. Model 

3 58 Relative Cos. Benefi.s Rankings for Center Sir. Comparisons Withm Men s 
Centers on Scale I Standard Cost Model 

3 59 Relative Cos. Benefit* Rankings for Center Si*. Comparisons Within Men's 
Centers on Scale II Standard Cost Model 

3.60 Relative Cos, Benefits Rankings for Center ^ Comparisons Wtthrn 

Women’s Centers on Scale I Standard C ost Model 
3.6, Relative Cost Benefits Rankings for Center Size Compar.sons W.thtn 

Women’s Centers on Scale 11 Standard Cost Mo 
3 62 Relative tffeetiveness Rankings for Comparisons Within Conservation 
Centers Types on Scale I Standard Cost Model 
3 63 Relative Cos, Benefits Rankings for Sponsor Comparisons Within Conserva- 
tion Centers on Scale II Standard Cost Model 
3 64 Relative Cos, Benefi.s Rankings for Sponsor Comparisons Within Men's 

Centers on Scale I Standard Cost Model 

3 65 Relative Cos, Benefits Rankings for Sponsor Comparisons Within Men's 

Centers on Scale II Standard Cost Model 

3.66 Relative Cost Benefits Rankings for Sponsor Comparisons Within Conserva- 
tion Centers on Scale I Standard Cost Model 
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TABLE 

NUMBER 



TITLE 



3.67 Relative Cost Benefits Rankings for Sponsor Comparisons Within Conserva- 

tion Centers on Scale II -Standard Cost Model 

3.68 Relative Cost Benefits Rankings for Sponsor Comparisons Within Conserva- 

tion Centers on Scale I Standard Cost Model 

3.69 Relative Cost Benefits Rankings tor Sponsor Comparisons Within Women’s 

Centers on Scale II Standard Cost Model 

3.70 Relative Cost Benefits Rankings for All Men’s Centers on Scale I Standard 

Cost Model 

3.71 Relative Cost Benefits Rankings for Men’s ('enters on Scale I Standard Cost 

Model S3 00 Set Up Costs 

3.72 Relative Cost Benefits Rankings for Men’s Centers on Scale I Standard Cost 

Model $1,000 Set Up Costs 

3.73 Relative Cost Benefit Analysis Rankings for All Men’s Centers on Scale 

II Standard Cost Model 

3.74 Relative Cost Benefits Rankings for All Men’s Centers on Scale III Standard 

Cost Model 

3.75 Relative Effectiveness Rankings for All Men’s Centers on Scale l Standard 

Cost Model 

3.76 Relative Effectiveness Rankings Within All Men’s Centers on Scale II - 

Standard Cost Model 

3.77 Relative Cost Benefits Rankings Within All Men’s Centers on Scale II 

Standard Cost Model, Gary L.O.S. Set to 225 Days 

3.78 Relative Cost Benefits Rankings for All Men’s Centers on Scale II Standard 

Cost Model, Gary L.O.S. Set to 210 Days 

3.79 Relative Cost Benefits Rankings for All Men’s Centers on Scale 11 Standard 

Cost Model, Gary L.O.S. Set to 195 Days 

3.80 Relative Cost Benefits Rankings for All Men’s Centers on Scale II Standard 

Cost Model, Gary L.O.S. Set to 180 Days 

3.81 Relative Cost Benefits Rankings for Women’s Centers on Scale l - Standard 

Cost Model 

3.82 Relative Cost Benefits Rankings for Women’s Centers on Scale II Standard 

Cost Model 

3.83 Relative Effectiveness Rankings for Women’s Centers on Scale I Standard 

Cost Model 

3.84 Relative Effectiveness Rankings for Women’s Centers on Scale II Standard 

Cost Model 
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AGE COMPARISONS 



Tables 3.1 through 3.19 



TABLE 3.1 



Relative Cost Benefits Rankings for Age Comparisons Within 
Men’s Centers on Scale 1- Standard Cost Model 



Overall 

Rankings 




Program by 


Program 


Comparisons 






17 Years 


20 Years 


.16 Years 


18 Years 


21 Years 


19 Years 


2 , IV 


1,1 


2 , IV 


2 , IV 


1,1 


17 Years 




4,11 


2, IV 


4,11 


4,11 


20 Years 






2 , IV 


3, IV 


3,H 


16 Years 








4,11 


4,11 


18 Years 










3,11 


21 Years 













TABLE 3.2 

Relative Cost Benefits Rankings for Age Comparisons Within 
Men’s Centers on Scale II Standard Cost Model 



Overall 

Rankings 


Program by 


Program Comparisons 






16 Years 18 Years 


19 Years 


21 Years 


20 ’’ears 


17 Years 


2 , IV 4,11 


4,11 


3,11 


3,11 


16 Years 


4,11 


4,11 


4,11 


4,11 


18 Years 




3,11 


1,1 


1,1 


19 Years 






1 , I 


2 , IV 


21 Years 








2 , IV 


20 Years 


• 
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TABU: 3.3 



Relative Cost Benefits Ranking!; for Age Comparisons Within 
Men's Centers on Scale III Standard Cost Model 



Overall 

Rankings 




Program by 


Program 


Comparisons 








17 Years 


18 Years 


19 Years 


21 Years 


20 Years 


16 


Years 


O 

o 


O 

o 


0,0 


0,0 


0 , 0 


17 


Years 




c 

o 


C 

o 


0 , 0 


0 , 0 


18 


Years 






0,0 


0 , 0 


0 , 0 


19 


Years 








0 , 0 


0 , 0 


21 


Years 










0 , 0 



20 Years 



TABLl: 3.4 

Relative Lffectiveness Rankings lor Ag: Comparisons Within 
Men’s Centers on Scale I Standard Cost Model 



Overall 

Rankings 




Program by 


Program Comparisons 






20 Years 


17 Years 


18 Years 


16 Years 


21 Years 


19 Years 


1,1 


2, IV 


2 , IV 


2 , IV 


1,1 


20 Years 




2, IV 


3 , IV 


2 , IV 


3,11 


17 Years 






4,11 


2 , IV 


4,11 


18 Years 








2 , IV 


3 , II 


16 Years 










4 , II 


21 Years 
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TABLE 3.5 



Relative Effectiveness Rankings for Age Comparisons Within 





Men’s Centers on Scale I 


Standard Cost Model 




Overall 

Rankings 


Program by 


Program Comparisons 






21 Years 20 Years 


18 Years 17 Years 


16 Years 


19 Years 


1,1 1,1 


1,1 1,1 


1,1 


21 Years 


2 , IV 


2,11 1,1 


1,1 


20 Years 




3, IV 1,1 


1,1 


18 Years 




1,1 


1,1 


17 Years 






1,1 


16 Years 









j 

i 

i 



! 

i 

) 

! 



I 

I 

i 
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TABLE 3.6 

Relative Cost Benefits Rankings for Age Comparisons Within 
Women’s Centers on Scale I - Standard Cost Model 



Overall 

Rankings 




Program by Program Comparisons 






1 7 Years 


1R Years 19 Years 70 Years 


21 Years 



16 


Years 


4,11 


4,11 


4,11 


4 , T I 


4,11 


17 


Years 




4,11 


4,11 


4,11 


4,11 


18 


Years 






3,11 


3, T1 


1,1 


19 


Years 




/ 




4, 11 


1,1 


20 


Years 










2 , IV 


21 


Years 
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TABLE 3.7 



Relative Cost Benefits Rankings for Age Comparisons Within 
Women's Centers on Seale II -Standard Cost Model 



Overall 

Rankings 




Program by 


Program 


Comparisons 






18 Years 


20 Years 


19 Years 


J 7 Years 


21 Years 


16 Years 


4 , II 


4,11 


4,11 


4 , II 


4,11 


18 Years 




4,11 


2 , II 


2 , IV 


1,1 


20 Years 






2, IV 


2 , IV 


2 , IV 


19 Years 








2 , IV 


1,1 


17 Years 










4,11 


21 Years 













TABLE 3.8 

Relative Cost Benefits Rankings for Age Comparisons Within 
Women’s Centers on Seale III Standard Cost Model 



Overall 

Rankings 




Program hy 


Program C 


ompa r i sons 






17 Years 


18 Years 


19 Years 


2 ] Years 


20 Years 


16 Years 


0 , 0 


0,0 


0,0 


0 , 0 


0,0 


17 Years 




0,0 


0,0 


0,0 


0,0 


18 Years 






0 , 0 


0 , 0 


0 , 0 


19 Years 








0,0 


0,0 


21 Years 










0,0 



20 Years 
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TAB LI: 3. 1 > 



Relative Effectiveness Rankings for \ge Comparisons 
Within Worren’s Centers on Scale l - Standard Cost Model 



Overall 

Rankings 




Proqram by 


Proqram 


Comparisons 






19 years 


21 Years 


18 Years 


17 years 


16 years 


20 years 


1,1 


1,1 


1,1 


1,1 


1,1 


19 years 




2 , IV 


1,1 


1,1 


1,1 


21 years 






3,11 


1,1 


1,1 


18 years 








1,1 


1,1 


17 years 










1,1 


16 years 













TABLE 3.10 

Relative Effectiveness Rankings for Age Comparisons 
Within Women’s Centers on Scale II- Standard Cost Model 



Overall 

Rankings 


Program by Program Comparisons 




19 years 


21 Years 


18 years 


17 years 


16 years 


20 years 1,1 


1,1 


1,1 


1,1 


1,1 


19 years 


2, IV 


1,1 


1,1 


1,1 


21 years 




2,11 


1,1 


1,1 


18 years 






1,1 


1,1 


17 years 








1,1 


16 years 
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TABLE 3.11 



Relative Effectiveness Rankings for Age Comparisons Within 
Women’s Centers on Scale III- Standard Cost Model 



Overall 

Rankings 




Program by 


Program Comp 


risons 






17 Years 


18 Years 


20 Years 


19 Years 


21 Years 


16 Years 


O 

o 


O 

O 


O 

% 

o 


O 

o 

i 


O 

o 

1 


17 Years 




o 

o 


o 

o 


o 

o 


o 

o 


18 Years 






o 

o 


o 

o 


o 

o 


20 Years 








o 

o 


o 

o 


19 Years 










o 

o 


21 Years 













TABLE 3.12 

Relative Cost Benefits Rankings for Age Comparisons Within 
Conservation Centers on Seale l - Standard Cost Model 



Overall 

Rankings 




Program 


r Program Comparisons 






17 Years 


18 Years 


19 Years 


20 Years 


21 Years 


16 Years 


4,11 


4 , XI 


4,11 


4 , T I 


4,11 


17 Years 




4 , II 


4,11 


3,11 


3,11 


18 Years 






3,11 


2,11 


1,1 


19 Years 








2, II 


2, IT 


20 Years 










3 , IV 


21 Years 
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TABLE 3.13 



Relative Cost Benefits Rankings for Ago Comparisons Within 
Conservation Centers on Scale 11 Standard Cost Model 



Overall 

Rankings 




Program by Program 


Comparisons 






17 Years 


18 Years 


1 9 Years 


20 Years 


2.1 Ye^rs 


16 Years 


3,11 


3, 11 


3,1 


3,11 


3 , rr 


17 Years 




3,11 


3 , T. 1 


3 ,11 


3,11 


18 Years 






3,11 


3,11 


1,1 


19 Years 








2 , IV 


1,1 



20 Years 1 > T 

21 Years 



TABLE 3.14 

Relative Cost Benefits Rankings lor Age Comparisons Within 
Conservation Centers on Seale HI Standard Cost Model 



Overall 

Rankings 




Program by 


Program 


Comparisons 






17 Years 


18 Years 


19 Years 


20 Years 


21 Years 


16 Years 


0,0 


0,0 


0 , 0 


0,0 


0,0 


17 Years 




0 , 0 


o 

o 


0 , 0 


0 , 0 


18 Years 






0 , 0 


0,0 


0,0 


19 Years 








O 

o 


0 , 0 


20 Years 










0,0 


21 Years 
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TABLE 3.15 



Relative Effectiveness Rankings for Age Comparisons Within 
Conservation Centers on Scale I Standard Cost Model 



Overall 

Rankings 




Program by Program Comparisons 






19 Years 


20 Years 


18 Years 


17 Years 


16 Years 


21 Years 


2 , IV 


4,11 


4,11 


3, TI 


3,11 


19 Years 




4,11 


4,11 


4,11 


4 , II 


20 Years 






3,11 


1,1 


1,1 


IB Years 








1,1 


2 , IV 


17 Years 










2 , IV 


16 Years 













TABLE 3.16 

Relative Effectiveness Rankings for Age Comparisons Within 
Conservation Centers on Scale II Standa-d Cost Model 



Overall 

Rankings 




Program by Program Comparisons 






20 Years 


19 Years 


21 Years 


17 Years 


16 Years 


18 Years 


4, IV 


4,11 


3,11 


3,1 


1,1 


20 Years 




4,11 


1,1 


1,1 


1,1 


19 Years 






1,1 


1,1 


1,1 


21 Years 








2, IV 


2 , II 


17 Years 










1,1 


16 Years 
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TABLE 3.17 



Relative Cost Benefits Rankings Cor Age Comparisons Within 



All Centers on Seale 1- Standard Cost Model 


Overall 

Rankings 


Program by Program Comparisons 






17 Years 18 Years 19 Years 


20 Years 


21 Years 


16 Years 


4,11 4,11 4,11 


4 , II 


4,11 


17 Years 


4,11 4 , T I 


4,11 


3,H 


18 Years 


4,11 


2,11 


1 ,1 


19 Years 




1,1 


1,1 


20 Years 






1,1 


21 Years 









TABLE 3.18 

Relative Cost Benefits Rankings for Age Comparisons Within 
All Centers on Scale 1 1- Standard Cost Model 



Overall 

Rankings 




Program by 


Program 


Compar i sons 






17 Years 


18 Years 


19 Years 


20 Years 


21 Years 


16 Years 


4 , II 


4,11 


3,11 


3,11 


3,11 


17 Years 




3,11 


3,11 


3,H 


3,11 


18 Years 






1,1 


1,1 


1,1 


19 Years 








1,1 


1,1 


20 Years 


■ 








1,1 


21 Years 
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21 years 



CITY SIZE COMPARISONS 

Codes used in Tables 3.20 through 3.35 should be 
interpreted in the following manner: 

(1) 2,500-rural area or under 2,500 population 

(2) 50,000— population of 2,500 to 50,000 

(3) 250,000-population of 50,000 to 250,000 

(4) Large-population of over 250,000 
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TABLE 3.20 



Relative Cost Benefits Rankings for 
City Size Comparisons Within Men's 
Centers on Scale I Standard Cost Model 



Overall 

Rankings 


Program by Program 


Comparisons 




50,000 250,000 


Large 


2,500 


1,1 1,1 


1,1 


50,000 


1,1 


2, IV 


250,000 




2 , IV 


Large 







TABLE 3.21 

Relative Cost Benefits Rankings for 
City Size Comparisons Within Men’s 
Centers on Scale II- Standard Cost Model 




Overall 

Rankings 


Program by 


Program Compari 


sons 






50,000 


250,000 


barge 




2,500 


O 

o 


o 

o 


1,1 




50,000 




1,1 


1,1 




250,000 






1,1 




Large 
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TABLE 3.22 

Relative Cost Benefit Rankings for City Size Comparisons 
Within Men’s Centers on Scale 111 -Standard Cost Model 



Overall 

Rankings 


Program by 


Program 


Comparisons 




50,000 


250,000 


Large 


2,500 


0,0 


0,0 


O 

o 


50,000 




0,0 


0,0 


250,000 






0,0 


Large 









TABLE 3.23 

Relative Effectiveness Rankings for City Size 
Comparisons Within Centers on Scale 1 
Standard Cost Model 



Overall 

Rankings 


Program by 


Program 


Comparisons 




Large 


50,000 


2,500 


250,000 


2, IV 


1,1 


1,1 


Large 




4,11 


1,1 


50,000 






1,1 


2,500 
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TABLE 3.24 



Relative Effectiveness Rankings for City Size 
Comparisons Within Men’s Centers on Seale II 
Standard Cost Model 



Overall 

Rankings 


Prog ram 


by Program 


Comparisons 




50,000 


Large 


2,500 


250,000 


1,1 


1,1 


1,1 


50,000 




1,1 


1,1 


Large 






1,1 


2,500 









TABLE 3.25 

Relative Cost Benefits Rankings for 
City Size Comparisons Within Women’s 
Centers on Scale 1- Standard Cost Model 



Overall 

Rankings 


Program by 


Program Comp ft r 


isons 




50,000 


250,000 


Large 


2,500 


1,1 


1,1 


1,1 


50,000 




2,11 ' „ 


l,T 


250,000 






3 , II 


Large 
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TABLE 3.26 



Relative Cost Benefits Rankings for 
City Size Comparisons Within Women’s 
Centers on Seale II -Standard Cost Model 



Over a 1 1 
Rankings 


Program by 


Program 


Comparisons 




50,000 


Large 


250 , 000 



2,500 


3 , 1 .V 


2 , II 


1,1 


50,000 




3,11 


1,1 


Large 






2 , TV 



250,000 



TABLE 3.27 

Relative Cost Benefits Rankings for 
City Size Comparisons Within Women’s 
Centers on Seale III - Standard Cost Model 



Overall 

Rankings 


Program by 


Program 


Comparisons 




50,000 


250,000 


Large 


2,500 


0,0 


0,0 


0,0 


50,000 




0,0 


0,0 


250,000 






0,0 


Large 











TABLE 3.28 



Relative Effectiveness Rankings for 
City Size Comparisons Within Women’s 
Centers on Scale I- Standard Cost Model 



Overall 

Rankings 


Program 


by Program 


Comparisons 




Large 


2,500 


50,000 


250,000 


3, IV 


1,1 


1,1 


Large 




2,11 


2,11 


2,500 






2, IV 


50,000 









TABLE 3.29 

Relative Effectiveness Rankings for 
City Size Comparisons Within Women’s 
Centers on Scale II -Standard Cost Model 


Overall 






Rankings 


Program by Program Comparisons 




250,000 ’50,000 


2,500 


Large 


2, IV 2,11 


1,1 


250,000 


2,11 


3,11 


50,000 




3,11 


2,500 








38 




TABLE 3.30 



Relative Cost Benefits Rankings tor 
City Size Comparisons Within Conservation 
Centers on Scale. I - Standard Cost Model 



Overall 

Rankings 


Program by 


Program 


Comparisons 




Largo 


250,000 


50,000 . 


2,500 


2, IV 


2,11 


2,1.1 


Large 




4 , II 


4,TT 


250,000 






4,11. 


50,000 









TABLE 3.31 

Relative Cost Benefits Rankings for 
City Size Comparisons Within Conservation 
Centers on Seale II Standard Cost Model 



Overall 

Rankings 


Program by Program 


Comparisons 




2,500 50,000 


Large 


250 , 000 


4,11 3,11 


1,1 


2,500 


3,11 


2 , IV 


50,000 




2, IV 


Large 
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TABU* 3.32 



Relative Cost Benefits Rankings for 
City Size Comparisons Within Conservation 
Centers on Scale III -Standard Cost Model 



Overall 

Rankings Program by. Program < 


'osnpn r i sons 




2 , r »no 


250 , non 


50 


,000 


Largo 0,n 


0,0 




0 , 0 


2,500 


0,0 




0,0 


250,000 






0,0 


50,000 









TABU: 3.33 

Relative Effectiveness Rankings for City Size 
Comparisons Within Conservation (.’enters on Scale 1 
Standard Cost Mode) 



Overall 

Rankings 


Program by 


Program 


Comparisons 




2,500 


250,000 


Large 


50,000 


2, IV 


2,11 


2, IV 


2,500 




2, IV 


2, IV 


250,000 






2, IV 


Large 
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TABLE 3.34 



Relative Effectiveness Rankings for City Size 
Comparisons Within Conservation Centers on Scale 11 
Standard Cost Model 



Overall 

Rankings 


Program by 


Program 


Comparisons 




250,000 


2,500 


Large 


50,000 


2, IV 


2 , II 


1,1 


250,000 




3,11 


1,1 


2,500 






1,1 


Large 









j 
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TABLE 3.35 

Relative Effectiveness Rankings for 
City Size Comparisons Within Conservation 
Centers on Scale III Standard Cost Model 



Overall 

Rankings Program by Program Comparisons 

2,500 50,000 Large 



250,000 


o 

o 


o 

o 


o 

o 


2,500 




o 

% 

o 


o 

o 


50,000 






o 

o 



Large 
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RACE 

TABLE 3.36 
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TABLE 3.36 



Relative Cost Benefits Comparisons for 
Racial Groups-Standard Cost Model 



Condi t Lons 

Men’s Centers, Scale 1 
Men's Centers, Settle II 
Woman's Centers, Scale 1 
Woman's Centers, Scale II 
Conservation Centers, Scale II 
Conservation Centers, Scale I 
All Centers, Scale II 
All Centers, Scale I 



Most. Cost Least Cost 

Beneficial Beneficial Level 



Negro 


White 


2, IV 


Wh i te 


Negro 


4,11 


Negro 


White 


2,1V 


Whi tc 


Negro 


4,11 


Negro 


Wh i te 


3,1V 


Negro 


White 


2, IV 


White 


Negro 


4,11 


Negro 


Whi te 


2, IV 



i 

[ 

j 

I 

i 

i 

j; 

i 

V 

| RACE AND CITY SIZE 

Codes used in Tables 3.37 through 3.44 should be 
interpreted in the following manner: 

(1) City size as in Tables 3.20 through 3.35. 

(2) Race: (B) Black 

(W) White 



l 
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TABLE 3.37 

Relative Cost Benefits Rankings for Race by City Size Comparisons 
Within Men’s Centers on Scale 1 -Standard Cost Model 





TABLE 3.38 
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TABLE 3.40 
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TABLE 3.42 
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TABLE 3.44 




250,000 (B) 



REGIONS 

Coiae for TaMn 3.46 through 3.61 may ha inter- 
preted in tha foMoadog manners 

'l flln I A fm * » 

■ "ViOrVrCfn vn^in 

2- Mid-Adanlfc Region 

3- South-Eatt Raglon 

4- Great Uko Region 
6-South W a t t R egion 
6-North Ce nt ra l Region 

r^WluVR VHpOR 



i 

! 



f 




53 

102 



TABLE 3.45 



Relative Cost Benefits Rankings for Region Comparisons Within 
Men’s Centers on Scale I Standard Cost Model 



Overall 

Rankings 




Program by Program Comparisons 






Region 2 


Region 2 


Region 7 


Region 4 


Region 1 


Region 5 


Region 6 


4,11 


4 , II 


1,1 


1,1 


1,1 


3 , T I 


Region 2 




4 , II 


2 , JV 


2 , IV 


1,1 


1,1 


Region 3 






2 , IV 


2 , IV 


2, IV 


1,1 


Region 7 








2 , IV 


2,11 


3,11 


Region 4 










1,1 


3,11 


Region 1 












4,11 



Region 5 



TABLE 3.46 

Relative Cost Benefits Rankings for Region Comparisons Within 
Men’s Centers on Scale II - Standard Cost Model 



Overall 

Rankings 


Program by Program Comparisons 






Region 3 


Region 2 


Region 4 


Region 7 


Region 5 


Regi.on 1 


Region 


6 4,11 


4,11 


1,1 


0,0 


3,11 


1,1 


Region 


3 


1,1 


1,1 


l , r . 


2,11 


1,1 


Fegion 


2 




2 , IV 


1,1 


3,11 


1,1 


Region 


4 






4 , 1 J 


4,11 


1 , 1 


Region 


7 








4,11 


1,1 


Region 


5 










2 , IV 


Region 


1 













0 
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TABLE 3.47 



Relative Cost Benefits Rankings for Region Comparisons Within 
Women’s Centers on Seale 1 -Standard Cost Model 



Overall 

Rankings 




Program by Prog 


ram Comparisons 








Region 3 


Region 7 


Region 5 


Region 2 


Region 4 


Region 6 


Region 


1 


3,11 


2,11 


3,11 


3, IT 


1 ,T 


1,1 


Region 


3 




2 , IV 


3,11 


3 , IV 


1,1 


1,1 


Region 


7 






4,11 


4,11 


1,1 


1,1 


Region 


5 








2 , IV 


2 , IV 


2 , IV 


Region 


2 










2,11 


1,1 


Region 


4 












3,11 


Region 


6 





















TABLE 3.48 










Relative Cost Benefits Rankings for Region Comparisons Within 
Women’s Centers on Scale II Standard Cost Model 




Overall 

Rankings 


Program by Program Comparisons 








Region 3 Region 5 


Region 2 Region 7 


Region 6 


Region 4 


Region 


1 


3,11 4,11 


4,11 3,11 


1,1 


1,1 


Region 


3 


4,11 


4,11 2,11 


i,t 


] ,1 


Region 


5 




2 , IV 2 , IV 


2 , IV 


2 , IV 


Region 


2 




2 , IV 


2 , IV 


2 , IV 


Region 


7 






1,1 


1,1 


Region 


6 








2 , IV 


Region 


4 
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TABLE 3.49 



Relative Cost Benefits Rankings, for Region Comparison Witliin 
Conservation Centers on Scale l-Standard Cost Model 



Overall 

Rankings 




Progr 


am by Prog 


ram Comparisons 








Region 4 


Region 6 


Region 5 


Region 2 


Region 3 


Region 1 


Region 


7 


4,11 


2,11 


2,11 


3 , II 


2,11 


2 , II 


Region 


4 




2, IV 


2 , IV 


1,1 


1,1 


I , 1 1 


Region 


6 






3 , II 


4 , II 


3,11 


2,11 


Region 


C 








4,11 


4,11 


2 , II 


Region 


2 










3, IV 


2 , IV 


Region 


3 












2,11 


Region 


1 















TABLE 3.50 

Relative Cost Benefits Rankings; for Region Comparisons Within 
Conservation Centers on Scale 11- Standard Cost Model 


Overall 














Rankings 


Program by Prog 


ram Comparisons 








Region 4 Region 6 


Region 5 


Region 2 


Region 3 


Region 1 


Region 


7 


4,11 1,1 


4,11 


2,11 


1,1 


1,1 


Region 


4 


2 , IV 


4,11 


1,1 


1,1 


1,1 


Region 


6 




4,11 


3,11 


i ,i 


1 , 1 


Region 


5 






3,11 


0,0 


1,1 


Region 


2 








3 , TV 


3,1 


Region 


3 










1,1 


Region 


1 













I 



5 O 

ERIC 
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TABLE 3.51 



Relative Cost Benefits Rankings for Region Comparisons Within 
All Centers on Seale 11-Standard Cost Model 



Overall 

Rankings 




Program by Program Comparisons 








Region 6 


Region 3 


Region 7 


Region 4 


Region 5 


Region 1 


Region 


2 


2 , IV 


2 , IV 


2 , IV 


2 , IV 


4,11 


1,1 


Region 


6 




4,11 


4,11 


I# I 


4,11 


1,1 


Region 


3 






2 , IV 


2 , IV 


4,11 


1 ,1 


Region 


7 








2 , IV 


4,11 


1 , 1 


Region 


4 










4,11 


3,11 


Region 


5 












2 , IV 


Region 


1 
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PLACEMENT AGENCYS 



Codes for Tables 3.52 through 3.57 may be inter- 
preted in the following manner: 

11— JCOS 

12— Local Employment Service 

13— Youth Opportunity Center (YOC) 




TABLE 3.52 

Relative Cost Benefits Rankings for Placing Agent Comparisons Within 
Men’s Centers on Scale 1 -Standard Cost Model 



Overall 

Rankings 


Progran by Program Comparisons 






12 11 13 


31 


51 


2 , IV 1,1 1,1 


3,11 


12 


4,11 4,11 


3,11 


11 


2 , IV 


3,11 


13 




3,11 


31 







TABLE 3.53 

Relative Cost Benefits Rankings for Placing Agent Comparisons Within 
Men’s Centers on Scale II -Stanard Cost Model 


Overall 






Rankings 


Program by Program 


Comparisons 




31 11 


13 12 


51 


3,11 1,1 


1,1 1,1 


31 


2 , IV 


2, IV 2, IV 


11 




2, IV 1,1 


13 




1,1 



12 



TABLE 3.54 

Relative Cost Benefits Rankings lor Placing Ag:nt Comparisons Within 
Women’s Centers on Si ale I Standard Cost Model 



Overal 1 
Rankings 


Program by Program Comparisons 






13 


12 


11 


31 


51 


2 , IV 


2 , IV 


2,11 


3,11 


13 




2 , TV 


4,11 


3 , T I 


12 






4 , IT 


3 , II 


11 








3,11 



31 



TABLE 3.55 

Relative Cost Benefits Rankings for Placing Agent Comparisons Within 
Women’s Centers on Scale II Standard Cost Model 



Overall 

Rankings 


Program by Program 


Comparisons 






31 M 


1 3 


12 


51 


3 , 1 1 1 , T 


1 , T 


1,1 


31 


2 , IV 


2 , TV 


2 , 1 1 1 


11 




2 , TV 


1,1 


13 






1,1 


12 
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TABLE 3.56 

Relative Cost Benefits Rankings for Placing Agent Comparisons Within 
Conservation Centers on Scale I Standard Cost Model 



Overall 

Ranking 


Program by Program 


Comparisons 






12 13 


1 1 


31 


51 


2 , IV 2 , IV 


1 , 1 


3,17 


.12 


3,11 


4 , TI 


4,11 


13 




4,11 


4,11 


11 






4,11 


31 









TABLE 3.57 

Relative Cost Benefits Rankings for Placing Agent Comparisons Within 
Conservation Centers on Scale II Standard Cost Model 



Overall 

Rankings 


Program by Program Comparisons 






1 1 1 3 31 


12 


51 


1,1 l , I 3,11 


1,1 


11 


2, IV 4, IT 


1,1 


13 


4,11 


1,1 


31 




2 , IV 


12 
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CENTER SIZr 
Tables 3.58 through 3.61 



TABLE 3.58 

Relative Cost Benefits Rankings for Center Size Comparisons Within 
Men’s Centers on Scale I -Standard Cost Model 



Overal 1 
Rank ings 


Program by Program 


Comparisons 




Small 


Larqo 


Medium 


H 

< 


l»t 


Small 




3 ,T 


Large 







TABLE 3.59 

Relative Cost Benefits Rankings for Center Size Comparisons Within 
Men’s Centers on Scale 11 Standard Cost Model 



Overall 

Rankings 


Program by Program 


Comparisons 




Sma 1 1 


Large 


Medium 


2 , IV 


0,0 


Small 




0,0 


Large 
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TABLE 3.60 

Relative Cost Benefits Rankings for Center Size Comparisons Within 
Women’s Centers on Seale 1 Standard Cost Model 



Overall 
Rank! ngs 


Program hv Program 


Comparisons 




Mori i.um 


Smal 1 


Large 


3, IV 


1,T 


Medium 




n , n 


Small 







TABLE 3.61 

Relative Cost Benefits Rankings for Center Size Comparisons Within y 

Women’s Centers on Scale II -Standard Cost Model 



Overall 

Rankings 


Program by Program 


Comparisons 




Large 


Small 


Medium 


1,T 


n , n 


Large 




3 , T I 



Small 
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CENTER TYPE 

Cedes useJ in Tables 3.62 end 3.63 may be inter- 
preted in the following manner: 

INT— Interior 
AG— Agriculture 
SR— State Related 




65 
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TABLE 3.6 2 

Relative Effectiveness Rankings for Comparisons Within Conservation 
Centers Types on Scale 1 Standard Cost Model 



Overall 

Rankings 


Program by 


Program Comparisons 




AG 


SR 


INT 


2, IV 


3, IV 


AG 




4 , IV 


SR 







TABLE 3.63 

Relative Cost Benefits Rankings for Sponsor Comparisons Within Conservation 
Centers on Scale II Standard Cost Model 



Overall 

Rankings 


Program by 


Program Comparisons 




INT 


AG 


SR 


1,1 


1,1 


INT 




2 , II 


AG 
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SPONSORING AGENCY 

Codes for Tables 3.64 through 3.69 may be inter- 
preted in the following manner: 

Center Types: 

1— Agriculture 

2— Interior 

3— State Related 

4— Women's Urban 

5— Men's Urban 

6— Environ mental- Developmental 

7— Recaption Centers 



O 

ERiC 



11G 



TABLh 3.64 



Relative Cost Benefits Rankings for Sponsor Comparisons Within Men’s Centers 

on Scale I- Standard Cost Model 



Overall 

Rankings 




Program 


by Pro 


gram Cnmpa r i.sons 






4 


1 


5 


3 


2 


6 


7 


2 , TV 


2 , IV 


3,11 


0,0 


3 ,1 


0,0 


4 




2 , IV 


4,11 


1,1 


1,1 


3,11 


1 






4,11 


3,11 


3 , II 


3,11 


5 








1,1 


3 ,1 


0,0 


3 










1,1 


3,11 


2 












4,11 



6 



TABLE 3.65 

Relative Cost Benefits Rankings for Sponsor Comparisons Within Men’s Centers 

on Seale II Standard Cost Model 



Overall 

Rankings 




Program 


by Program Comparisons 






1 


5 


4 


3 


2 


6 


7 


1,1 


3,11 


1,1 


0,0 


0 , 0 


0,0 


1 




4 , II 


4 , II 


3,11 


3,11 


3,11 


5 






1,1 


1,1 


1,1 


1,1 


4 








3,11 


1,1 


3 , II 


3 










1,1 


3,11 


2 












4,H 


6 
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TABLE 3.66 

Relative Cost Benefits Rankings for Sponsor Comparisons Within Conservation 
Centers on Scale I- Standard Cost Model 



Ovcral 1 
Rankings 




Program 


by Prog 


ram Compa 


r i sons 






1 


7 


4 


3 


2 


6 


5 


2, IV 


4,11 


3,11 


1,1 


1,1 


1,1 


1 




4,H 


4,11 


3 , II 


1,1 


1,1 


7 






2 , IV 


1,1 


1,1 


1,1 


4 








1,1 


1 ,1 


1, C 


3 










3,11 


2,11 



2 2 , IV 

6 



[ 

f. 

f 

f 

! 

i- 

I 

I 

\ 

i 

i 

t 



\ 



\ 

\ 

1; 

f 

l 

t 



! 

o 




TABLE 3.67 

Relative Cost Benefits Rankings for Sponsor Comparisons Within Conservation 
Centers on Scale II Standard Cost Model 



Overall 

Rankings 




Program 


by Program Comp 


arisons 






5 


7 


4 


3 


6 


2 


1 


3,11 


4,H 


3,11 


3,11 


1,1 


1,1 


5 




4,H 


3,11 


3,11 


1,1 


1,1 


7 






2, IV 


1,1 


1,1 


1,1 


4 








0,0 


1,1 


1,1 


3 










1,1 


1,1 


6 












3,11 


2 
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TABLE 3.68 



Relative Cost Benefits Rankings for Sponsor Comparisons Within Conservation 
Centers on Scale I- Standard Cost Model 



Overall 

Rankings 




Program 


by Prog 


ram Comparisons 






4 


5 


6 


i 


2 


3 


7 


2 , IV 


2 , IV 


2 , IV 


2 , IV 


1,1 


1,1 


4 




4,11 


1,1 


2 , IV 


1,1 


1,1 


5 






2, IV 


2 , IV 


1,1 


1,1 


6 








3 , IV 


1,1 


2,11 


1 










0,0 


1,1 


2 












3,11 



3 



TABLE 3.69 



Relative Cost Benefits Rankings for Sponsor Comparisons Within Women’s 
Centers on Scale 11 -Standard Cost Model 



Overall 

Ranking 




Program 


by Program Comparisons 






4 


6 


5 


1 


3 


2 


7 


1,1 


1,1 


1,1 


1,1 


1,1 


1,1 


4 




2,IV 


2, IV 


2, IV 


1,1 


1,1 


6 






3, IV 


2 , IV 


1,1 


1,1 


5 








2 , IV 


1,1 


1,1 


1 










3,11 


1,1 


3 












1,1 


2 
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MEN'S CENTERS 



Tables 3.70 through 3.80 




TABLE 3.70 

Relative Cost Benefits Rankings for All Men’s Centers on 
Scale l- Standard Cost Model 



Overall 

Rankings 




Program by Program Comparisons 






Kilmer 


Clearfield 


Atterbury 


Gary 


Parks 


Breckinridge 


3 , II 


2 , IV 


It I 


1,1 


1,1 


Ki lmer 




2 , IV 


L » I 


1# I 


1,1 


Clearfield 






4,11 


4,11 


1,1 


Atterbury 








4,11 


If I 


Gary 










1,1 


Parks 













TABLE 3.71 

Relative Cost Benefits Rankings for Men’s Centers on Scale 1 Standard 
Cost Model $300 Set Up Costs 



Overall 

Rankings 




Program by 


Program Comp 


arisons 






Ki lmer 


Clearfield 


Atterbury 


Gary 


Parks 


Breckinridge 


3,11 


2, IV 


1,1 


3 , II 


1, 1 


Kilmer 




2, IV 


1,1 


1, 1 


1, 1 


Clearfield 






4,11 


4,11 


1, 1 


Atterbury 








4,11 


1, 1 


Gary 










1,1 


Parks 













ERIC 



TABLE 3.72 

Relative Cost Benefits Rankings for Men’s Centers c n Scale I-Standard 
Cost Model- $1,000 Set Up Costs 



Overall 

Rankings 


Program by Program Comparisons 




Ki lmer 


Clearfield 


Atterbury 


Gary 


Parks 


Breckinridge 3,11 


2 , IV 


3,11 


1,1 


1,1 


Ki lmer 


2 , IV 


3 , II 


1,1 


1,1 


Clearfield 




4,11 


4,11 


1,1 


Gary 






2 , IV 


1,1 


Atterbury 








1,1 


Parks 













TABLE 3.73 

Relative Cost Benefit Analysis Rankings for All Men’s 
on Scale II Standard Cost Model 


Centers 




Overall 

Rankings 




Program by Program Comparisons 






Kilmer 


Clearfield Atterbury 


Gary 


Parks 


Breckinridge 3,11 


1,1 1,1 


3,11 


0,0 


Kilmer 




2, IV 2,11 


3,11 


1,1 


Clearfield 




3,11 


4,11 


0,0 


Atterbury 






4,11 


1,1 


Gary 








1,1 


Parks 
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122 



TABLE 3. 7 4 



Relative Cost Benefits Rankings for All Men’s Centers 
on Scale HI Standard Cost Model 

Overall 

Rankings ’ 'rograro by Program Comparisons 





Clearfield 


Atterbury 


Ki lmer 


Gary 


Parks 


Breckinridge 


O 

o 

1 


0,0 


0 , 0 


0,0 


0 , 0 


Clearfield 




0 , 0 


0 , 0 


0,0 


0 , 0 


Atterbury 






0 , 0 


0,0 


0,0 


Kilmer 








0 , 0 


0 , 0 


Gary 










O 

o 



Parks 



TABLE 3.75 

Relative Effectiveness Rankings for All Men’s Centers 
on Scale I Standard Cost Model 



Overall 

Rankings 




Program 


by Program 


Comparisons 






Gary 


Kilmer 


At herbury 


Parks 


Clearfield 


Breckinridge 


4,11 


3 , IV 


1,1 


1,1 


1,1 


Gary 




2 , IV 


1,1 


1,1 


2,11 


Kilmer 






2 , IV 


2 , IV 


2 , IV 


Atterbury 








2, IV 


2 , IV 


Parks 










2 , IV 


Clearfield 
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Tables 3.81 through 3.84 
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TABLE 3.82 

Relative Cost Benefits Rankings for Women’s Centers 
on Scale II-Standard Cost Model 
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TABLE 3.84 

Relative Effectiveness Rankings for Women’s Centers 
on Scale II- Standard Cost Model 
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Appendix 

INTERPRETATION OF TABLES 

The discussion which follows is a portion of the Discussion of Results, Section 
IV, Volume I. It has been duplicated here to facilitate the analysis of the tables in 
Section III. 

It is presented below without modification: 

An analysis of the six men’s centers using the cost benefits model produces the 
ranking of the programs which is induded in Table 4.1. 



TABLE 4.1 

Relative Cost Benefits Rankings for Men’s Center Programs 
Using Scale I.— Standard Cost Model 





Overall 

Rankings 


Program by Program Comparison 




RANK 


PROGRAM 


KILMER 


CLEARFIELD 


ATTERBURY 


GARY 


PARKS 


1 




Breckinridge 


3,11 


2 , IV 


1,1 


1,1 


1,1 


2 




Kilmer 




2 , IV 


1,1 


1,1 


1,1 


3. 




Clearfield 






4,11 


1,1 


1,1 


4 




Atterbury 








4,11 


1,1 


5 




Gary 










1,1 


6 




Parks 













In the above table the arabic numbers represent levels 



of assumption under convex conditions. Roman numbers represent 
assumptions under concave conditions. The cell entry is the 
level at which the program in .column one is determined to be 
more cost beneficial than the program heading the other 
columns . 
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Column one in Table I represents the relative rank of the six programs. The 
numbers (arabic and roman) in the other columns of the table represent th : level of 
assumption which must be made for any given center to outrank another. The arabic 
number pertains to convex assumptions concerning the benefits curve. The roman number 
represents concave assumptions. A further explanation of these assumptions follows. 



An interpretation of the table shows Breckinridge to be the most cost beneficial 
men’s center and Parks, the least cost beneficial. In between, the other centers rank as 
indicated on the left: Kilmer is second: Clearfield is third; and so on. This ranking is 
based on Scale I and the standard cost model. 

Reading the rest of the table is a little more difficult due to the concepts 
involved. But it is the numbers which contain most of the important information 
concerning the rankings. The discussion of the model in Section II of this report gives 
considerable attention to the nature of the benefits curve. That is, if one were going to 
assign values to the outcome categories described by the scale, how should the values be 
assigned? The numbers in the table tell the reader how the values would have to be 
assigned if the cost benefit ranking is going to be accepted. 

The meaning of the numbers, in light of the Table 4.1 discussion, is summarized 



Exhibit 4.1 



Examples of Convex 



and 

Concave Benefits Curves 




2 3 4 5 6 7 8 

Category 
Convex curves 



2 3 4 5 6 7 8 

Category 
Concave curve 



below. 



A. The number zero is the most powerful case. It is seldom seen, but if seen, it 
means that it is not possible to reach any other decision concerning the 
ranking, no matter what set of values are chosen for the categories. They can 
be scored best to worst; worst to best; high in the middle, low at either 
end anything goes. 

B. The number one, arabic or roman, in practical applications, is alums', as 
powerful as zero. It requires only that the benefits curves, values assigned to 
the categories, arc ordinal. That is, being a member of category eight is more 
valuable (beneficial) than being a member of category seven by some amount, 
small or large; and similarly, category seven has more value associated with it 
than category six; six beats five; and so on. (Note: it is all right for one or 
two groups to have the same value, so long as the values are not decreasing 
ones. ) s 

C. The number two is slightly more restrictive than one. In the case of the 
number one, the shape of the benefits curve is completely irrelevant. The 
values simply increase from lowest to highest across categories. That the curve 
is convex (opening upward) or concave ^opening downward) does not matter. 

Specifically, level two assumptions require the user to determine 
whether most of the corpsnicmbers’ benefits are greatest in the first few 
categories or in the upper categories. When are benefits gained from the 
program. For Scale I, which is heavily affected by length of stay, the question 
reduces to whether or not a corpsman benefits most from his early days in the 
program or from his later days in skill training. 

D. Level three is only slightly more restrictive than level two. It simply says that 
the shape of the curve is important as in level two', but in addition there must 
be some perceptible gain for every category. Level two permits one or two 
categories to have the same value an almost meaningless restriction in the 
case of a complex training program like Job Corps. 

H. Level IV is the most restrictive case considered by the model. To accept a 
cost benefits ranking at this level means that the reader must assume that the 
benefits curve is linear (represented by a straight line which passes through 
the origin.) The latter simply means that the first outcome corresponds 
to a failure condition with no associated benefit. Such a set of values for 8 
categories might be: 

(0. I. 2, 3, 4. 5, 6. 7) 

or 

(0. 10. 20, 30. 40, 50. 60, 70) 

or 

j (0, 153, 306. 45‘L 612. 765. 918, 1071) 
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Returning to the results in Table 4.1: 



TABLK 4.1 

Relative Cost Benefits Rankings for Men’s Center Programs 
Using Scale I. Standard Cost Model 



Overall 

Ra nkings _ _ Program by Program t:nr;|iuf i so n 



PfY:y~ 


"program 


KILMER ~C LEA R F IE L D 


"ATTERBURY 


’_gary_._ 


PARKS 


l 


Break inr idge 


3,11 2 , IV 


1,1 


If I 


1 , I 


2 


Kilmer 


2 , IV 


1 , I 


1,1 


1,1 


3 


Clear f ie Id 




4,11 


1 , 1 


1,1 


4 


Atterbury 






4,11 


1,1 


5 


Gary 








1 , I 


6 


Parks 




- 







Column one represents the overall ranking of programs. The arabic and roman 
numbers represent the level of assumption necessary to accept a given comparison 
between programs. As the numbers increase, the power of the comparison decreases. It is 
not possible, however, for the rankings to be reversed. Rather, the user may choose not 
to accept the assumptions necessary and assume no relative program difference. 

Consider: 

Breckinridge is determined more cost beneficial than Atterbury, Gary and Parks at 
level one. This means that no matter what set of ordinal values the user chooses to assign 
to the outcome categories, Breckinridge remains the most cost beneficial. It does not 
matter whether one argues that most of the benefits are obtained early in the program or 
conversely, if one argues that the greatest value is attained late in the program. This is an 
exceptionally strong position. 

Breckinridge is determined more ost beneficial than Kilmer at level three under 
convex' assumptions and at level two under concave assumptions. The fact that the model 
requires this level of assumption indicates a greater degree of closeness than in the case of 
the above described three centers (Kilmer is also more cost beneficial than Atterbury, 
Gary, and Parks at level one.) Yet, Breckinridge remains significantly in position since the 



model requires only that the values continue to increase if the convex case (greater worth 
later) is accepted, and that if the concave case is accepted, the increase to be regular and 
steady, with no two categories having the same value. Any of a very large set of benefits 
curves will satisfy these assumptions. 

For example: 

In the convex case. Breckinridge would beat Kilmer cost benefits wise if the 
values assigned to the eight categories were either: 

(0, 1, 2, 3, 4, 5, 6, 7) 
or 

(0, 1, 4, 9, 16, 25, 36, 49) 
or 

(0, 2, 6, 12, 20, 30, 42, 56) 

In the concave case, either of the following sets of values would satisfy the 
conditions: 

(0, 10, 15, 15, 16, 17, 18, 19, 10) 
or 

(0, 1000, 1500, 2000, 2100, 2102, 2103, 2103) 



In four cases a linear assumption is necessary for program by program compar- 
isons to be made. It will be seen later (during discussion of cost models) that even this 
most restrictive case is a relatively strong position, and that comparisons which require 
level four may still be quite significant. 

In summary, Table 4.1 indicates that Breckinridge is the most cost beneficial 
program of the six examined and further, that Breckinridge and Kilmer emphatically beat 
Atterbury, Gary, and Parks in the rankings. Further, as might be expected, it typically 
requires a higher level assumption for a program to be determined more cost beneficial 
than the next in line, than it does for those further down the rankings. Parks proves least 
beneficial and, significantly, is bestecj by all programs at level one on this scale. 
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